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these occupations were rated by experts for importance and time spent 
in their performance, A set of 31 knowledges, skills^ abilities, and 
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the: professional and adninistrative carp:^r 



A 3ST:\ACT 

Tne work of the L'nited Star.cs Civil Service Cor.:?.issior.' 6 Per s 1 Research nnd 
Deve lopn^rnt Ceni:er to develop '2 b^sLs for uhe vricten cest port:ion . Liie Profe s s : •.■>n2 i 
and Administrative Career Exarnin^cion (PACE) is described. Th^ obiective of the 
research was the identi f ica ?: ion of a construct valid set of cognitive abilities tests 
appropriate ror selecnion of app 1 icar. t s tor entrv lev- I positions In Federal nroies- 
sionai,, ad"-.inistra tive . and technical occupations. Tne occupational coverage ol the 
examination was defined and a set oi 27 occupations selected for intensive scud}'. 
These occupations represented appr.)xin;ately seventy percent of annual appointments in 
the occupations to be cov^ered by ihe PACE. Duties of the 2 7 occupations were rated by 
subject matter experts for importance and relative amount of time spent in their per- 
formance. Subject matter experts also rated a specially developed set of 31 knowledges, 
skills, abilities, and other worker characteristics (KS.AO's) in terms of their impor- 
tance for overall j ?b per f cr:.iance . Six cognitive abilities were hypothesized as 
important for duty performance and were rated by personnel research psychologists. A 
method was devised for combining subject matter expert ratings with psychologist 
ratings to determine the relative weight of each abilitv within each occupation. Pat- 
terns of ability weights to be applied to subtests for each job resulted from this 
process. Test question type/ were identified from tl-^e professional literature as 
measures of the abilitiej^ to be included in the test. Factor analysis of the subject 
matter expert ratings oi the 31 KSAO's provided support for the abilities. Research, 
needed to provide additional technical support for the test was outlined. 
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METHOD 

SelecLLor: cf occupation.- for study 
Xdent i t ica t ion of nia ior di.it ies 

Identification of kno wl ed ,s o s , skills, abilities, a nd o i: h e r wo r ke r 

characteri sties 
Rating of duly inporLance and i ine soent in per iOT--:;anct.- 
Rating of KSAO ' s 

Identification of abilities proposed for the v^'ricti/n ttrst 
Definition of abilities 

Rating of abilities pr.oosed for the written test 
Analysis of data 

Choosing acceptable measures of abilities 

RESULTS AND DISCUSSION 

Ratings of duty importance and t iir.L^ _ 
Rating of abilities proposed ^or the written test 
Development of test weight's for occupations 
Ratings of KSAO ' s 

Assignment of the remainder of PACi^ occupations to occupational 
categ;ories 

SUMMARY AND [PROSPECTUS 

REFE K-:NCE' notes 

REFERENCES 

APPENDIX A 

Thirty-one Knowledges, Skills, Abilities:, and Other Characteristics 
Required for Successful Per f orrriance in Twenty-seven Occupational 
Series 

APPENDIX B 

Means and Standard Deviations of Ratings of th^.' Importance of Duties 
(1) and Time Spent in Performance (T) by Subject Matter Experts in 
Twenty-seven Occupat ions 

APPENDIX C 

Mean Importance Ratings of Knowledges, Skills, Abilities, and Other 
Characteristics for Each Job Series and for AH Job Series Combined 
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I", iuie r L" a r.L-'ii to prov iGe »-ne 
cbe i-ro fess iona 1 and Adnin- 
c -J r c a 1 n t r v ~ 1 e v e i d o s i - 



One function 'i^t t b. i- L'n i z ed S t a l ^i- s 
Sonne 1 2;:ency oi cne recU/ral Cov^;' r :r:)e:^ 
Federal employees inro the conpo C it ive 
»f the .e;overnr:;enc . 



■ :v:;::-. ; s i cMi . as t n e central pe r ~ 

■ ?-;K-nt. ! svsireniy for selecting 
iriclr.dL-s most T'ositions in the 



executive brand 



Civil Service' conpetitive e xa:- ina L i .vn s rv/.st by lav and regulations be '.'practical 
in character and as far as possible relate to :?.att:ers tliat fairly test the relative 
capacity and fitness of the applicants for th.^- a ppo in t rrient sought" ( 5USC 3304). In 
order to meet this requirement of law. examinations mus^. be job related 

. 5USC 3313, 5L'SC 331 
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trial prac t i c 
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5rSC 3 318) r ecu ire c and id a t es to be ranked . 
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select: ini: from 
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Because o l th e 1 a r ge n um^ e 
large number of applicants, tiie 
straints, discussed 
grouped in terms of 
abilities be validly assessed in the examination 



f fitness. This latter provision dis- 
m> r i L ^- ■ ■ s C e m s f r on • t b. e c o mmo n Indus- 
na\->- m.e : some minim.um. qual i f icat ions . 

:s ( current Iv aboui 2200) and the 



i s complex 



?rac tical con- 



oc c upa I c 
unc C i OTi it 

below, make it necessarv that, for examining purposes, occupations be 
the abilities w'nich underlie successful performance, and that these 
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Historical pe r spective on abil i ties me : 
d e ve 1 o pme n t in the Civil Service C omm i s s i o n 
leading theorist.s and researchers in abil it; 
of the relativelv short but rich, history oi 
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Research underlying written test 
based i ri large p-.:-t: on the' findings of 
testing. Fo] lo'.s'ing is a brief review 
:: he measu remen t of cognitive abilities. 



/ The scientific studv r- trht-se abilities began with Sir Francis Calton (Tuddenham, 
19j^2; Chaplin 6. Kraweic, IV " In t^. 1 1 igence" was assumed to be a c omb ina t ion o f 

si/mpler elements, specifically of simple psyciiomoror skills such as reaction time and 
pi\tch discrimination. This e 1 emen t a 1 i s t i c t'neory was discredited when ^ 
J.'He^^-e-n Cattell's ctudent, Vissler. tried to use measures of suc'n skills to predict 
the grade-point averages of Columbia University freshmen in 1901, and failed. Con- 
temporaneously, Charles Spearman, a student of Gallon's, was developing the mathematics 
of correlational analysis, pos c u 1 a L i n tliat "mental ability" was really a unitary 
factor, called "g" for "general." 
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In France, Alfred ;> i n e t wa s d e .-.i I i n g v i t: 1 1 t h e [.-> r a c t i 
children needed special assistance because tney veru unable 
ronment. After reviewinc> the relevant r«.*searcb. . tie conclud 
from schooling was a co-:ipleK entity and should be assessed by task 
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learn in the school envi- 
t ii a t the -ability to p r o f i J 
wh i. ch represented 
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"Test" reforf 



? c i f i c a 1 1 V 



In Federal examining practice, r ' ^ l- './en" .1 e x a ni i n a t. 
of procedures by which selection for emp l(;>ymi;n t is madt,' 
to the written test. An examination may or may n.ot include a written test. In broad- 
band examining, several occupations with similar knowledge, skill, ability, or other 
worker- characteristic requirements are included under one examining procedure. 
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TipicMi-v the. uncerlving variable vitboLil calling ^or knowledce vhich could be 
^^^V^i-^^^ rh- sitiiaLior vhich che ability v:? "tr .:ess::rv . By Binet and 

ineoJorv Si".-:: . ;:>iru' ::;:*s;' principles. ^i::c developed a :-s: to acconipLi^.i zhe assigned 
ta.sk. VithLii a i-^v yo.nr'^, :?s vc h j 1 og i s t s fro^ other coiintri-.^s troi^slated the test for 
iriei^- ovn use. Levis Term;?n published a revision of Binet's test, the S t an f ord ~B ine t , 
in 1916, shorclv berore the United States entered World War 1. 

Psycho ioc I s t vished to help win this war and determined th.at thev could assist in 
tne classification o: draftees in the ar-ed services (Korr.an. *.971). The Stanford- 
■iSmet was, h.owever, inappropriate, a? it v;as adminis tered on an individual basis, 
hardly u i t .■■:>. e thr- task c- 1 assessing' h ndreds of ch.ou sands of new soldiers. A 

committee or psyc ho lo.t: i r ts was forned to he^p with the war effort (Goodenough, 1949). 
rii 1 s corr.n^ittee developed and put into use the Army Alpha rist to screen over one and 
a hal t nil lion rr^en for dccepzc:nce as enlisted men, for officer training, and for place- 
ment in various jobs. The- test nieasured simple reasor'ng, following directions, arith- 
Tjetic, and- inrorn^ation. although only the total score. ot a score for each ability 
t e s t e d , va s u s e d . 

rhv uiilLtv j: the total scor'^ was assumed, and one finds little reference in cur- 
rt.-.u >ni:rc-.^s ^ for exaiTipl-. Guilford, 1967 ) as to how useful the Army Alpha actually 
VIS. Apparent i V ^i t had drav.'backs as veil as benefits. After the war came a great in- 
crease in the production of tests and test items: and in test usage for occupational and 
school selection as well as for individual guidance ( Korman , 1971). 'There also de- 
veloped a concern with what was being measured and why. There appeared to be non- 
cognitive abilities, such as r.usical talent and mechanical aptitude, that could be more 
important than cognitive abilities in certain situations. There appeared to be more 
than just the one underlying ability, the "g" of Spearman. In addition, the course of 
the ileve 1 opm.ent of multiple cognitive abilities was not well understood. 

Concurrently, the statistical technique of factor analysis, originated by Spearman, 
was developed as a means of studying the interrelations of tests (Chaplin S Krawiec , 
1968). Factor analysis is a method for identifying the common dimensions which under- 
lie such interr-^ lationships . Reference to the work of Louis. L. Thurstone, the origi- 
nator of motJi^-". factor analysis, serves to illustrate the development of tests- and 
factor analys: dMrinp. the 1930's. -Thurstone did not accept Spearman's hypothesis of 
a general factv.: :. ability; rather, he postulated multiple factors of^ability under- 
lying . pe r formance on ccM^nitive tests. In a major study, Thurstone (1938) administered 
56 psychological tests to volunteers at the University of Chicago. He in tercor re I a t ed 
the sccres~-on these tests and factor analyzed the resulting correlation matrix. 
There were six underlying dimensions, or "Primary Mental Abilities," for performance 
on these tests: verbal, number, spatial, word fluency, memorizing, and reasoning 
(Thurston- ft Thurstone, 1941). If "factor-pure" tests, measuring one ability each, 
could be developed, then .in accurate prediction of performance on the tests in the 
original battery could ho made from performance on these six "factor-pure" tests. 

Thr- imnl i ca L ifMi , extensively developed in military selection during World War II, 
was that a s:.:.-! ] 1 nnmlvr or juire measures could be used to predict performance that 
depended upon a laree number of the abilities combined in ^ complex fashion. Dramatic 
changes in tecb.noloev had made- the ta-"- of accurate selection and placement of soldiers 
in World War 11 even more critical than in World War I. There was a great deal of 
testint^ usint; batteries moasurin):' a number of abilities. The Army Air Corps Aircrew 
Classification Batterv used scores weighted differentially for different jobs. This 
battery was c imk-.^ t rue ted to measur- psycho 1 og i ca 1 constructs adjudged to be important for 
success in pilot training. The tests used were not factor-pure but each measured a sub- 
set of the relevant abilities (Guilford^ Hoepfner, 1971). The battery was constructed 
along factorial lines (Guilford, 1967). 
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After line war, test deve 1 ; r^r^en!: eifor:s cont ir.u-:d , sone empnasizmg tzctors 
abilirv vhich could be corroino d ' in diff-rc-t vays for different predictions. Thes- .ests 
measured "factors" in th- manner of th^ Aircrew Classification Battery, not in the 
factor-pure manner of Thurstone, The United States Hr:iplo>-P.ent Service, using Thurstone 
as a consultant, developed the Ge-iaral Aptitude Test Battery (GATE) for a variety of jobs 
(Guilford, 1967). In the Civil forvice Con^mission, Ernest S. Primoff constructed a 
multiple-abilities battery to i-easure "elements" foiznd m t: .es and industrial jobs. 
This batteiy was later expanded to measure additional elemer._s found in clerical jobs 
(Primoff, Note 1). The Differential Aptitude Test was developed for use in high school 
as an acace^ric and vocational counsel in? tool Cronbach , 1970). 

With the increased number of tests and test batteries came atteu.pts to analyze 
and synthesize research findings in human abilities testing. One comprehensive de- 
scription of factor analyses of aptitude and achievement tests dealt with hundreds of 
tests in 69 factor analytic studies carrie: out in diverse settings (French, 1951), 
In 1963, a sec of reference tests was identified for cognitive abilities based on 
factors so identified (French & nK.strom, 1963). Various other authors have hypothe- 
sized over one hundred cognitive ability factors. Although much basic research is 
still in process, a considerable number of abilities underlying human behavior have 
been identified and- reliably measured. 

Summary of examinine; for entry- level professional , administrative , and technical 
positTons in the Federal service. Many professional, administrative, and technical jobs 
require the same kinds or knowlSdees, skills, abilities, and other worker characteris- 
tics. In 1939 the United States Civil Service Commission established the Junior Pro- 
fessional Assistant Examination (J?A) as n comprehensive program to select applicants 
for entry-level positions in 28 different Federal occupations. The requirements for 
passing this examir.ation were two: specific experience or college education relevant 
to the designated occupation, and ■ p-rformance at a high level on a w-ritten test. The 
test consisted of a verbal compr -.-he :i s ion ability section and a specific test of know- 
ledge of the subject matter required for the occupation. An individual v;ould apply 
separately, and be considered separately, for each of the 28 occupations. 

After World War il, changes were made in both the written test and the background 
requirements. The subject matter sections of the written tests were dropped, as it 
became more and more difficult to maintain up-to-date test material for such a wide 
variety of occupations. However, work experience or education now had to be related 
directly to the occupation pursued. Quantitative reasoning and. abstract reason^ng^ 
abilities questions were added to the written test. This change was generally satis- 
factory, but several examining issues remained- First, the demands for such specialized 
preparation nroved to be a barrier to liberal arts graduates and to others who, despite 
their lack .f specific experience, had high levels of basic ability to learn and to 
perform the duties of the jobs. Second, many Federal occupations have no specific 
experience requirements or have no industrial counterparts where people can gain 
experience. Internal Revenue Officer, Customs Inspector, and Social Insurance Claims 
Examiner are examples. Third, employment in the Federal service provides the oppor- 
tunity for mDbilitv in professional and administrative assignments, often requiring the 
ability to change and to keep up with advances in technology as well as ability to 
adapt to' shifts in social attitudes and practices. 

The ability to learn new material appeared common to many occupations. It could 
be appropriately measured by one examination for those occupations. Such an examination 
would be convenient to both the applicant and to the Federal Government as it would 
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expanc che candidate's opportunities for enployrr.ent one career development. Thus the 
Federal Service Entrance Examination i?SZR) was intrccuced in 1955. Tne FSEE had two 
basic requirements: appropriate experience and an ade :ate level of ability to deal with 
the complexity and difficulty of the journeynian or ca: -jer-level demands of the occupa- 
tions covered. The experience requirement could be met with three years of relevant 
wor.. experience or a bachelor's degree. A written test was used, here a.ssessing ver- 
bal, quantitative, 3nd abstract reasoning abilities. The occupat ion.s had an entry- 
level of GS-5 or GS--7, and with certain exceptions, the normal progression fo*' succe.ss- 
ful employees was to a full performance level of GS-ll or above. Occupations requiring 
both the stated experience and the necessary configuration of abilities assessed bv 
the written test were filled primarily through the FSEE. 

Some years later, in 1963, the occupational coverage was reviewed. Certain 
scientific and . prof es s ional positions which required highly specific and extended aca- 
demic preparation were determined to be r ore properly filled through other techniques 
of examination, and were excluded from FSEE coverage. Simultaneously, the written 
test was reviewed for the remaining occupational coverage. The measurement of abstract 
reasoning ability was dropped, so that the test now measured verbal and quantitative 
ab il i t ies . 



The need for a new writte n test. The test wr.s kept under continual review, r.nd 
by 19 70 it was clear that changes were desirable. The examination itself was almost 
fifteen years old. The test wa, working well but it was now technically feasible to 
introduce significant iipprovemen t s . .Advances in data processing capability made 
differential weighting of test scares cf large numbers of applicants practical. The 
FSEE written test measured two abilities, verbal and quantitative, determined by job 
analyses to be necessary to learn and to progriass to full performance levels in the 
occupations covered by the examin3.t ion , Further, the verbal section carried approxi- 
mately twice the weight of the n nan t i t a t ive sec t ion , a weighting which, while it was 
optimal for a majority of occupations and hence useful for the mobility concept, might 
not be optimal for all FSEE . oc c upa t ions . While the written test of the FSEE was 
designed to measurv"*. two abilities which were and are common job requirements, technical 
a'ivances made it fei^sible to measure additional abilities to reflect more accurately 
and comprehensively rcil, reasonable, and important qualifications underlying effec- 
tive job behavior. 



It was recognised that a systematic process was necessary to "determine the rela- 
tive importance of the qualification requirements for the job in order to identify 
those of greatest relevance for m<?asui. ement and, if appropriate, for later weighting 
when measures are combined" (USCSC 1972). It -s also recognized that existing methods 
of job analysis did net provide efficient ic ification of ijnderlying abilities common 
to large numbers of occupations. 



For these reasons the United States CI il Service Commission decided in late 
1972 -to undertake the development of a new examination for the entry-level positions 
of professional, administrative, and technical Federal occupations. 
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St-aregy of va lidation — -onst ruct validity . Test development : egir.s vitn_ tne 
choic e ;f a strategy ror va . IZITI^ the t..t -- t.-3 way in which _the degree _ to wnicn the 
test measures what it is supposed to r.easura will be .hown . Pror-:5Sionals _ in testing 
have concurred in stnting their goals for assessment or huir.an characteristics, as codi- 
fied in Standards f or Eancational and Psychological Test s (.American Psychological 
issociatlTn" "American Educational Kesir.rch Association, S National Council on Measure- 
n-ent in Educntion, 197^-.0. Thev agiee that "questions of validity are questions ot what 
-^av prop-rlv be inferred from a test score" (Standards, p. 23) and propose three types 
'of' strategy to explicate the relarionshio betw..a the test predictor and the inferred 
criterion-relatea final proaucc or cricefion: criteri.-.-rol .^,ted validx:.>, conter.t_ ^ 

validity, and construct vai.iaic>. . .^r .q.i-. u- 1 u .-o > ■,^p^..-b u.;l,i. c i 

stat^sti'-al relationship between test score and measures ot some cr'.t-rion, such as 
acade-nic'erade or ic^, performance. Content validity implies that tho test measures 
some representative samrle of the content of the criterion, such as :enographic skills 
or knowledge of lathe operating procedures. Construct validity requires hypothesizing 
of various Dsychological consrr-acts important - r performance both on cne test and on 
rh£ criter^n' the development cf measures of :r.e.se constructs; and the- gathering ot 
ev-dence to support both the relationship of the predictor and Che criterion via the 
coP<-.tructs as well as to -r.plicaUi the constructs themselves. It is obvious that 
'•these aspects of ■ aliditv can be discussed independently, but only for convenience. 
They are interrelated o-.rationa 1 _ y , and logically . . ." (Sta^idards. p. 26). 

Ir dete-nin-ng th,: process •;o use in validating the new examiaat ion . it appeared 
that content validity w.s least relevant. Selection would be of individuals who 
could progress to succ ssful performance in occupations for which they currently had 
no knowledge or exneri noe, occupation.? that could easily change from the time ot _ 
their selection to' the time of their achieving jov.rnevnan status. Tne case for cri 
tev-ion-re.ated validitv was more plausible, but 5-. could not be accepted as the sole 
strategy either, for two reasons. The first is the technical infeasibil ity of 
collecting enough ^oh incumbents together to perform satisfactory statistica_l studies. 
Th^ occupations to" be covered are diverse. For most, there are relatively tew incum- 
bents- these workers are often scaccerec amon;. many geographical areas and Federal 
installations. Occupations with largerl number s of incumbents might or might not empha- 
size the same duties depending upon che| requirements ot, their employing agencies. The 
.^(•ond reason, m.:c,h more critical, ic that this validation strategy has limited generali- 
zability Criterion-related studies in those occupations where data collection is 
f-asible would assess whether scores on the written test were statistically correlated 
with measures of job performance criteria. Such stuaies in themselves can explicate 
neither the methodology used in job analysis, nor the procedures used in written test 
specification and construction, nor the scientific judgment required to relate the 
written test to the job analysis. Further, such studi individually would say little 
if anything about the proper use of this written test for occupations where criterion- 
related studies were not feasible but job analysis was. Vfl-.at must be validated 
this examination are the psychological constructs posited. Aseries of criterion-related 
validity studies can be the means of providing much of the evidence required for con- 
struct validity- 

The first ste-^. in the validation process was to select the constructs, specify their 
assessment both in'rhe job and in the written test, collect preliminary data supporting 
Che identity of the constructs and tne relationship of test to job via the _ construe ts , 
and plan the subsequent research required for complete documentation. Empirical evidence 
is vital to any validation strategy, but the gather ing.of it need not be limited to en- 
ter ion-re 1 a ted statistical studies. Rather, empirical evidence is necessary to elaborate 
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and define ."he no:T.ol Dzic al ; r k , : r , ; • 

constriicns at ■■ b:i>ic ^ntirie^ ^Cronbach I . ' 

And- 'as one * . '^e dear.s oi An;orican v ji^v;-.. : r i < 

The "-inc which we want to ^ake is :hac ration::: nn^Ivsis ai>d juc^-pnt 
" re t. • f- iJar.entsI ba^is lor zbr^ us-^ ■^r i- >-e->n-.i 



.nd t ' . c s . a t i s t i c a 1 p ro c o d - : re 5 
o, an-. n:::t as a substituue 
p. 212) 

Re s e a r c 



a:-j-j as : irui.:;? anc: S:jpple;T:ent 
^^^1^- i'::^:!;e:u. ^ i": o r rid i ke , 19-- 



p.p. no^oec£ive. In view or the ^bove oon- :Ierat ions . the objective ot '"he 

P-C. research W3. tne identification or a set of construct valid cocnitivP a^^.ties 
te..s appropriate ror selection of applicants for a broad ran.e of profess^or:r a^^in- 
^'^^k T'' '"'^^^^f occupations. Tnese occ upa 1 1 on s .have% usual entr^ ^^v;! c f 

.^o. GS-7 and a full pertormance f j ourneyman ) level of GS-9 or above. The ou 

ot tne research was to include the fcilowing: ---m.^ 

1. Identification of a n.mber of cognitive abilities, or ds vcholog ical con- 
structs, required ror successful oerror.ance in the occ. pa t ion s ' t o be covered!'' 



2. Development of a svster 
as sessT.ef! t of the relative ir.^oi 



---^'^^ aruj 1 ys is . whi.j':i could provide an 

o . t i: d ao 1 1 1 t :.c s I o r sue c e s s r u 1 per fornix nc e . 



^ 3. Specificar.ion of a nev wru:ter. cest which would assess :he Dcrformance of 
applicants in each ability and which vould provide differencial weighting of abilitv 
test, scorres for differing job requ i repen: s . 

4. Specification of need for ::.ture research studies to provide additional 
support and documentation of the ,-,nstruct validation strate^v used to develop the 
new examination. v^it^tj Lue 



METHOD 

To reach the objective, the research ceam had to choose a ^.anageable number of occu- 
pations to study, then list the duties of each, and then define the abilities underl^ ng 

uccessful performance of the^e duties. Next, the researchers>had to find ways to 'rlt. 
Che duties for importance in .acn occupation, to rate the ah^'ities for their importance 
to performance of each duty, and to combine these tv ratings so as to provide weights 
Z ^^^^.f^^^^^^^-^-h occupation. Finally, tests had to be developed to measur^ 
deLr^ied'e^ov''^ '''''''' = ^'^^ ^^^^ — plished are 

Selection of occupations for study - Since some 120 Federal occupations fit che 
scope of coverage requirenients described above, it w:,s necessarv tj reduc<^ the ]oh 
analysis problem to a manageable size. Manpower need projections were not available 
t.. records of placements in 1970 and 1 972 were. The researchers assumed that wh i e 
some fluctuation in hiring rates would pr.,-.bably occur, a reasonably large sample of 
n^^ °TJ"llrT "1 agencies would embody „,ore than half the hires to be made 

tT:1 ;h ^"°'^^^"«l>'' 27 s.:: occupations were selected for intensive analysis. 

Table 1 lists these occrpations with the numbers of placements in 1970 and 1972 In all 
selections in these occupations account for over 69 percent of hires from the Federal ' 
Service Entrance Examination in those years. Inspection of Table 1 reveals the wide 
diversity of Che occupations. Many of them are found only in the Federal service com« 
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in onlv one "^deral agency. With few exceptions, it is unreasonable to require eitht^ 
specific aca.. ^.ic preparation or work exp rience applicants for these occupations, 
It was apparer.. that ranking of candidate, would have to depend on rr.easures oi those 
abilities which were basic to successful perfor^innce in then. 



"In-Demand" High Use ^'cc upa t iona 1 Series 
for 1970 and 1972 Combined 



Series 



Oc c upa L ion 



Placemen vi s ' 



993 


Soc iai Insurance Cia ims Examining 


1690 


Customs Inspection 


1169 


Internal Revenue Officer 


105 


Social Insurance Administration 


334 


Comput er Specialist 


526 


Tax Technic ian 


1811 


Criminal Investigating 


: jO " 


Budget Administration 


201 


Personnel Management 


1102 


Contract and Procurement 


3-^i3 


Management Analysis 


110 


Economist 


996 


Veterans Ciair:is Examining 


570 


Financial Institution Examining 


1816 


Immigration Inspection 


2001 


General Supply 


187 


Social Services 


967 


Pass rt and Visa Examining 


1854 


Alcohol, Tobacco and Firearms Inspection 


1710 


Educational and Vocational Training 


962 


Contact Represc^ntative 


1082 


Writing and Editing 


1810 


General Investigating 


1081 


Public Information Specialist 


1712 


Tra ining Ins t rue t ion 


685 


Public Health Program Specialist 


180 


Psychology 



1697 
997 
960 
882 
880 
77U 
619 
. 5A0 
533 
493 
389 
373 
364 
34 6 
340 
266 
235 
211 
202 
193 
181 
143 
135 
105 
98 
65 

52 

1 2,069 



Note. Data for 1971 were not available at the'time 6f the study. 
BurealTof Recruiting and Examining, U.S. Civil Service Commission. 
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IdontificaCLon ol m/iior ^nt.^^ . Thr Civil Serv :e Commission conducts intensive 
analyses ol or r ..p.u i ons to Jovolop c ! .) m s i t i c a t; i on ;in.: qualification standards. Those 
analv<^os ar- p.. r { o rnu'd hv skill. o,.- : p;i t: i a 1 analvsL.. in accordance with accepted 
position classincnrion pra<.:tf.->^s, ( M s s i f i ca t i o- ^^tandards id<>ntifv and ^roup jobs 



[ ih co[:iir.on C(.mU '..mK-. i n t. > i i^vr\:':>t i 



■'i 1 •-• ■ 1 on .-i nd pa y pu r p(^ s^ - s . The se 



^^^^^^^■■'^■^ 'M-'..d dnii.^'- M.M-rori:i-d hv in.aimbonLs of the oecupa- 

'•■^■t'^ '^^i -i^p:"' ■ 'i::;r;iin- priint; W.y liu' special job analysis 

•■ _^-niMov,si M: III.. I'Ai!. r.-s..,ir.^:,. i a 1 i i i a t i o n standards deli^-->-!te education", 
''^'7 i^t.-n-T- !i 1 r^•;:; !! f s : , > r- c : /d) I i sh i n/ i:iini:.iirn I i p; i b i i : :, v at various 
^^'^'^'l'- ^'^''1- vithm -ccnpai:,-';. VACr. r. , • ^u was to he designed to identify appli- 

cants ua(^ vo;j1o : i p r i o r p.- r t o r;;i- r s on the )oh. The researchers, then, were not 

r bar(?ly acceptable performance. 



interest*-d in asurinr Liu 



TiiO r..^ foro , ! i 1 1 



ded ro 



use v;:)s ;:iadr f tli- (j na ' ■ : i c a t i on standards in this study. 



class: I icat :on standards w.:r.. ro v i e;.-- i , and the major duties performed at the 

^•raae ^'^-V.! occupir^d hv cho ;.:reat.;st n'.ji;d)-r o; omployo^-s were extracted. This as taken 

to be the journeyman" or ." i n i 1 no r r o nr.anc e " level to which most of those entering the 

occupation .at the GS 5/7 levels could expect eventually to advance. The number of major 
duties V.'] : led ^ dcpen: mp. upon the content oi the occupation. 

Ident ification of kn owl e d.i;es , skills, abilities, and other worker cha rac ter i s r ^' c s > 
As major duties were extracted from the c 1 as s i f ic a t ion s t anda rd s , the researchers' ~ 
educed a set of 3 1 knowledges, skills, abilities, and other worker characteristics 
(KSAO's) underlying successful performance in the occupations. These variables were 
defined m terms of the behaviors as-sociated with them, and, where appropriate, the 
definition included examples of- job situations in which the KSAO's are impor t an t / The 
aim was to list KSAO's that had been described in the measurement literature. With 
resp^tt to content and lnvr>i of specificity, the list of 31 KSAO's resembled lists pre- 
viously developed for selection purposes by the American Institutes for Research 
(Theo^logus, Romashko. & Fleishman, 1 9 70) and the Civil Service Commission (Primoff, Note 
2). Ihe KSAO's were to provide a framework for describing the occupations in terms of 
the -tributes of successful performance and to provide a basis for selecting abilities 
to be measured by the written test. A complete list of the KSAO's, with their defini- 
tions, is p r o V i d e di in. A p p e. n d i x :\ . 

Hatm.^ of duty i mpor t a nc£_and_n me^.s^ performance . A sample- of employees 

m senior-level and s n [)e r v i stM'y {.os i t ions' wals selected for each occupation. These 
"subject matter experts" ( SMh ' s ) were chosen from 26 Federal agencies, in locations 
throughout- the country, that were major employers in the occupations. Seventy-six " 
separate -roups of SMK ' s , a total of 1241 persons, pa r t i c i pa ■ '-d in the research. 
The rating sessions were ..ach conducted by one of three of the members of the PACE 
team of researchers, each of whom speciali^^ed in several of the occupational series. 
Table 2 shows characteristics of each occupat ion. and the distribution of SHE ' s among 
the :cupa t ions . 

/■ 

The SME's were asked to review the list of duties for their occupation. The first 
group to review an occupation wa s e ncour a s>ed to amend the list of duties or add to it 
as appropriaie. Considerable discussion snider the guidance of the researcher often 
characterized this part of the procedure, with resultant changes in wording of existing 
or proposed duty statements. Subsequent SME groups in the occupation did not change 
the list but were free to add to i t . 

Subject matter experts next rated each -luty for its importance in the context of 
successful performance of the total job. They then ated each duty in terms of rela- 
tive amount of time spent i n i t s pe r f o rmance . 
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The following rating scales were used: 



Importa nce of Duty for Job Success 

0 No Importance 

1 Insignificant 

2 Slight Importance 

3 Some Importance 

4 Important 

5 Very Important 

6 Great Importance 

7 Critical 



Time Spent on Duty Compared to 
Other Duties Performed 



0 No time spent 

1 Very Much Below Average 

2 Below Average 

3 Slightly Below Average 

4 Average 

5 Slightly Above Average 

6 Above Average 

7 Very Much Above Average 



TABLE 2 



Series 



Characteristics of 27 PACE Occupations and 
Distribution of Subject Matter Experts 



Occ upa t ion 



Modal 
Grade 



No. of 

Dut ies 



No. of 

SME's 



No* of 

SME 
Groups 



105 Social Insurance Administration 

110 Economist 

180 Psychology 

187 • Social Services 

201 Personnel Management 

334 Computer Specialist 

343 Management Analysis 

526 Tax Technician 

560 Budget Administration 

570 Financial Institution Examining 

685 Public Health Program Specialist 

962 Contact Representative 

967 Passport and Visa Examining 

993 Social Insurance Claims Examii'iing 

996 Veterans Claims Examining 

1081 Public Information Specialist 

1082 Writing and Editing 
1102 Contract and Procurement 
1169 Internal Revenue Officer 

1710 Education and Vocational Training 

1712 Training Instruction 

1,810 General Investigating 

1811 Criminal Investigating 

1816 Immigration Inspection 

1854 Alcohol, Tobacco, & Firearms Inspection 

1890- Customs i ipection 

2001 General Supply 
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20 


68 


4 


14 


12 


40 


3 


13 


10 


9 




7 


6 


16 




13 


16 


77 




12 


11- 


7 3 




12 


13 


60 


4 


9 


9 


53 


3 


13 


14 


69 


5 


12 


9 


20 


1 


13 


6 


20 


2 


9 


7 


40 


2 


10 


7 


16 


1 


10 


10 


78 


4 


12 


8 


40 


2 


13 


10 


25 


2 


12 


9 


30 


. 2 


12 


8 


58 


;4 


12 


' 11 


71 


'A 


9 


16 


39 


'2 


9 


6 


40 


2 


11 


8 


36 


2 


13, 


14 


60 


4 


9 


6 


36 


2 


9 


10 


34 


2 


9 


10 


68 


4 


0 


19 


65 
1241 


4 
76 
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Rating of KSAO's . After complt-ting the ratin^^^ of duties, trho SME's studied the 
list of :U KSAO 5i described earlier and shown in Appendix A. They then r.^itred each 
KSAO for its (,v(>rall importance to successful Jom pe r fn rman c e . The snine 0-7 impor- : 
tance scale that was used ror fitity i[np(n: taiu; e rarinj^, was eraploved for KSAO importance 
rating. 

Ldent i f ical i on oi a h i 1 i Lj^e 'sed !.he v ^rit t t'ii LesL . The identification 

and ratinu or dut iT-s anii und^-rMn,^ V'^U^iPT^ ^ufrrfj'^d a i^Veat amount of information 
essential to developing a scujud e>:am i.na t i on . However, this information was not suffi-' 
cient. There remained the pr()hlt>;ns of idencilyina ^3stable abilities rhnt applied to 
■all the jobs covered and of choosing: appropriate item types to measure these abilities. 
To accomplish this, the res^^archors examined the KSAO • s and the factor analytic liter- 
ature relating to co.^nitivc ability measurement. Attention was focused on cognitive 
abilities because of their known usefulness in predicting job performance, and because 
of regulatory and practical restrictions on other measures. It was not possible, for 
example, to measure sevorol aspects of personality, as the Federal Personnel Manual 
(Chapter 337, Subchapter l-5i) expressly prohibits the use of personality tests except 
as part of a medical determination of fitness (U.S. Civil Service Commission, -.1969). 
Certain other KSAO ' s , such as object perception and physical stamina, were given rela- 
tively low importance ratings^by SHE ' s , and were therefore not considered further. 

Several sources of information were consulted in the effort to identify appro- 
priate t es t ab 1 e abilities. The most comprehensive compilation of evidence concerning 
cognitive abilities measurement was found in French's monograph (1951)^ Despite its 
age, this monograph remains a major source of information about factors extracted from 
aptitude and achievement tests. It integrated results obtained in 69 factor analytic 
studies, and identified 59 factors. Item types included in these studies form the 
basis of most of the abilities tests in use today. 

The cognitive components of the 31 KSAO' s described earlier were compared with' 
the 59 factors in the monograpTi. Neither the set of KSAO ' s no-r the'factors in the 
monograph were designed to consist solely of cognitri-V,e abilities, so it is not surpris- 
ing that only six matches were found. The content of KSAO ' 5 has already been discussed 
m this report. The French monograph included many noncognitive factors, such as 
ambidexterity and 1 iberal-conservat ive . Table 3 lists the matched abilities and the 
number of instances the factor was identified in the monograph. Certain of the matches 
do not- reflect exac t" corres pondenc e . General rea soning ability relates to the factors 
of deduction and induction, while arithmetic computatio n and quantitative reasoning 
relate to the number factor described by French. It should be noted t ha t ■ quan t i tat ive 
reasoning is often found to load on deduction and verbal comprehension fac tors . Fur- 
ther, the literature relating to cognitive abilities testing "is complex, and cognitive 
factors are generally somewhat interdependent. Six abilities, for which there were 
reasonable matches with those identified in the monograph, were selected for closer 
analysis of their relationship to job performance. 

llie six abilities as they were redefined, constituted t^ie set of cognitive ability 
constructs for which PACE test items would be developed. These abilities are well 
established, they appeared to-be reasonably related to successful performance o!^"'The 
kinds of jobs to be filled from PACE, and they appeared to be a manageable number to 
include in an examination for employment in which large numbers of applicants are 
assembled for examination administration.^- 



■"The test which ultim--ely was developed measures only five abilities, but takes 
almost four hours to a dm in i '^^r. 
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TABLE 3 



PACE Cognitive Abilities Matching 
Factors Described by French 



Cognitive Ability 



Fac tor 



General Reasoning 
General Reasoning 
Judgment 
Memory 

Arithmetic Computation 
Quant i tat ive Reasoning 
Reading Comprehension 



Ded ction (3?) 
Induction (9) 
Judgment (5) 
Associative Memory (16) 
Number (35) 
Number (35) 

Verbal Comprehension (46) 



Note, Numbers in parentheses indicate the number of studies in which the factor 



was found* 



Definiti on of abilities . The abilities were defined to reflect both the mental 
operations involved in the jobs and the work processes to which they were most applicable . 
The ability definitions which follow were given one- or two-word labels. This was. 
done with great reluc tance , for editorial convenience in making reference to specific 
abilities in the remainder of this report. Short labels, such as these, are inade- 
quate to describe the abilities, and can result in misunderstanding when used in 
communication with persons who are not thoroughly familiar with the fuller descriptions 
presented in rhis paper. Readers are cautioned to avoid using such labels without 
ascertaining that their audience is familiar with the full descriptions of the 
abilities. 

1, The ability to reason from principles to the implication of these principles in ^ 
specific situations. The ability to reason from given premises to ,eir necessary 
conclusions. The ability to think clearly about the implications of given facts. 

.This ability. would be very important in developing a system, plan, or procedure* 
For convenience, it is referred to as deduction in the remainder of this report. 

2. The ability to generalize from specific data to general facts. The ability 

to examine specific facts and to arrive at a\l understanding of their >underlying 
relations. This type of reasoning includes the formation and test^^^.g^ o'f hypothe- 
ses. It would be important in solving problems. Hereafter referred to as 
induction. 
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3- The ability to solve a presented problem when all the facts for solution necesssary 
are not given. Solution to the problem involves making some reasonable assumptions 
or anticipating what the most likely of several possible occurrences might be. 
This is the ability to make good decisions in such circumstances. It is important 
when decisions must be reached based on incomplete evidence. Hereafter referred 
to as judgment . 

4. The ability to retain a large quantity of inform^^t ion . This ability is important 
when a large quantity o f in forma t ion must be qu ickly recalled , or when the refer- 
ence system for storing needed information is ii7adequate. Hereafter referred tv 
as memory » 

5. Facility in manipulating numbers in any form. This ability is important where 
numbers are utilized. Tney are either calculated or numerical problems are solved. 
Hereafter referred to as number. 

6. Knowledge of, understanding of, and the ability to manipulate the English language. 
Effective command of the English language. This ability is important when the 

duty requires use of the English language. Hereafter referred to as verbal 
comprehension . 

Rating of abilities proposed for the written test . A group of six personnel 
research psychologists- not previously associated with the study was assembled to rate 
the importance of each of the six known ability constructs for measurirr performance 
of the duties [performed in the 27 jobs, . Classificat ion standards were studied, duty 
lists were reviewed and understood, and ratings were made in strict accordance with the 
definitions of the abilities. These psychologists were all exper ienced in the use of 
tests for selection of employees. They used the same rating scale, that was Used by 
the SME * 8 to rate duty importance. 

Analysis of data . For each occupation, ratings had now been obtained on eight-point 
scales for the importance of each duty for successful job performance, the relative amount 
of txme spent on each duty, the importance of each of the six abilities for performance 
of each duty, and the importance of 31 KSAO's for overall job performance in each ' 
occupation. 

Reliability of the various ratings was measured by dividing the rater groups into 
random halves and calculating the product-moment correla t ion c^oe f f ic ient of the mean 
ratings of each half for each duty or ability being rated. 

A critical link in the chain of procedures leading from job requirements to the 
test was the mathematical procedure for combining ratings of duty importance and time 
spent with ratings of ab'Lity importance for duty performance. . It was this combina- 
tion that would provide aa economical" determination of the relative importance of the 
abilities for job performance in each occupation. Relative importance of the abilities 
vos to provide the basis for weighting subtests designed to measure the abilities.^ 
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For each of the 27 occupational series, the importance of each abi t:y construct 
was calculated. Means of SME ratings "f: duty importance and time spent .ere summed, 
divided by two, and multiplied by the psychologists' ratings of the importance of the 
ability for performance of the duty. The resultant products for all the duties in the 
occupation were summed and divii' d by the total number of duties in the occupation. 
The formula for accomplishing this is: 



CD 



where : 

AI^ ~ The importance ofabilityifortheoccupation; 

,Ij = The mean rating of importance?, of duty J; 

Tj = The mean ratlTig of time spent on duty j; 

A^j = The mean importance rating of ability i for performance of 
duty j; . 

\^ J = 1, 2, . . . duties of the occupation 

.'^ = i , 1, , , , 6 abilities ' - 

' = Number of duties in the occupation 

While this form^ula yielded valuable information concernim^^the importance of the 
ability construes, there remained the problem of determining the relative weight of 
enci-. ability to be applied to test scores for each occupation. The large, number of 
occupations to be included in PACE made it impracticable to conduct criterion-related 
validity studies to obtain test weights through multiple correlation techniques. How^ 
ever, the comprehensive rating process .r^f duties and abilities for the sample of occu- 
pations couM provide weights with one additional step. This was done by obtaining 
for. eacii /'.h-lity its proportion of the tojtal of all the ability importance iAl) values 
in earh occupation. The formula for this \s simply: 



AW. 



^ 6 
i=l 



where : ' ' ' 

A^^'l = Weight of ability i, tor the occupation; 
i4Jv = Importance of ability i for the occupation, from (1); 
t = 1 , . . . , 6 abilities 
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These values were rounded to whole numbers for examining convenience, since applying 
fine weights adds practically nothing to the predictive validity of a test batterv 
(Dawes & Corrigan, 1974). Rounded weights were expected to provide a manageable 
number of weighting patterns, each including one or more occupations. Rounded weights 
were derived by multiplying the AW values by ten and then rounding to a whole number. 
These weights could then be used i. f f eren t ia 1 1 y to predict success in vrirlous occupa- 
tional categories. 

It is often desirable to classify a large number of elements according to some 
presumed relationships. To accomplish some objective groupings of the 31 KSAO's and 
the 27 jobs sampled in this research, factor analysis procedures were employed. Fac- 
tor analysis is a procedure used "to assign each entity or element to a group such 
that there is a well-defined basis for 'belonging to a group' and that the groups are 
clearly distinguishable one from another" (Harman, 1972), A factor analysis of 
ability importance would group the occupations according to the relative importance 
of each ability for each occupation. The occupations had already -/been grouped in 
terms of the similarity of their J weighting patcerns. These two' procedures should 
provide similar results, because the basic-,data, ratings of importance of abilities, 
are the same. A second factor analysis was undertaken to group the 31 KSAO's into 
categories which could be compared to the abilities. 

Choosing acceptab le measures of abilities . Identification of specific test 
question types to measure the abjlities was deferred until data analysis was completed 
and the final detersinination of abilities to be tested was made. Se lec t ion \0 f ques t ion 
types was based on both technical and administrative considerations* Where feasible, 
two question types would be employed for each ability. The monograph of French (1951) 
and the Manual for kit of reference t es t s for cognitive factors (French, Ekstrom, & 
Price, 1963) served as the primary sources for identification of test question ^ypes. 
Since th^ test was to be administered to some ZOO, 000 persons per year, ques t ionxtypes 
had to b:^ amenable to group administration with machine scoring of answer sheets. \^ 
Accordingly, it was decided that questions would be of f ive-al terna t iv.e mul t iple-~choice 
format, but otherwise following the "reference kit" question types as t^losely as po.s- 
sible. Where deviations from the reference kit tests were to be made, care was to^bo 
taken that the mental processes required to answer the questions would conform to th.e 
^•mental processes required to answer questions in the corresponding reference kit tests- 
The descriptions of the question types which follow are adapted from the bo^lclet of 
, sample questions given to each PACE competitor. 

The ability to reason- from general principles to the implications of these prin- 
ciples in specific situations, to reason from given premises to their necessary con- 
clusions, is measured by inference questions and tabular completion questions* The 
inference question type presents a statement which is to be accepted as true and should 
not be questioned for purposes of the test. Tlie correct alternative must derive from 
the statement without drawing on additional information not presented. Incorrect 
alternatives rest, to varying degrees, on the admission of new information. Inference 
is a test for the syllogistic reasoning factor in French, Ekstrom, and Price (1963). 
Tabular completion questions present charts or tables in which some entries are mi.^sing. 
The examinee must deduce the missing values. This question type has a mean loading of 
.46 on the deduction factor in two studies noted in French (1951). 

Letter series and figure analogies question types measure the ability to gener- 
alize from specific data to general facts, identifying underlying relations ' or. anal- 
ogies in the data. Letter series questions ccrnsist of a set of letters arranged in a 
definite pattern. The examinee must discover what tVie pattern is and determine the 
letter which should occur next in the series. Letter\ series occurs in tour studies 
included in French (1951), in which the mean loading on induction factors Wcis .49. 
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Figure analogy questions each consist of two sets of symbols where a corrmon cliaracter- 
istic exists among the symbols in each set and where an analogy is maintained b(^tween 
the two sets of symbols. A syifiboi is missing from one of the sets. The examiriee 
must discover vjhich alterncitive fits the missing symbol in such a way as to preserve 
the characteristics commoa to the second set and to pi'eservo the analogy with the first 
set. This question type fits the description anci is sirnilrir to the Kit^nre Clr'U:sifi" 
cation Test, in the reference kit of I-r^'nef'j, l-.l^; s c rom , anci rri.-e (19()3). 

The ability to solve problems when all tiie relevant facts are not given, to infer 
missing facts in data and missing events in c?ut-of~order sequences, is measured cur- 
rently by a test of comprehension. In fiscal ye<?r 19~7, logical order of events ques- 
tions wiLL al'!'- be used to measure this ability. In comprehension questions the examinee 
is required to ^.etermine the most plausible or reasonable alternative which might 
ex; lain or follow from a given statement. Selection of the best alternative requires 
general knowledge not included in the original statement,, l"/hile more thsn one alterna- 
tive may be plausible, the correct answer is the most plausible of the alternatives. 
Comprehension had a mean loading of .34 on the judgment factor in two studies reported 
in French (1951). Logical order of events questions require the candidate to deterniine 
the most reasonable sequence of occurrence of a set of events. This determination may 
require application of general knowledge to infer missing concepts or events that are 
essential to the sequencing of the elements of the set. This question type is suggested 
by the Practical Judgment and Sequence of Maneuvers tests identified as measuring the 
ability as exposited in French (1951). 

The ability to perform or check arithmetic operations and^-to solve quantitative 
prob'l'ems of varying conplexity is measured by computation and by arithmetic reasoning 
questions. Computation, questions require straightforward calculation and may include 
decimals, f rac t ions , . and percentages. Arithmetic reasoning questions are word problems 
which require quantitative reasoning processe^s for their solution. These question types 
have vTiean loadings of .43 to .82 on the number factor in studies noted in French ( 1 95 1 ) . 

^ -'"^ Verbal comprehension ability is measured by reading comprehension and vocabulary 
questionri. Reading comprehension questions require the examinee to read a given para- 
graph and to select an answer on^ the basis of comprehension of the conceptual content of 
the paragraph. The correct answer is either a i /orded statement of the main concepts 
in the paragraph or a conclusion so inherent in zhe paragraph content that rt;is equiva- 
lent to a restatement, Reading comprehension tests had a mean loading of .66 on the 
verbal comprehension factor in six studies noted in French (1951). Each vocabulary 
question contains a key word and five alternative choices. The examinee is to select 
the alternative word that is closest in meaning to the key jword . The incorrec t • a 1 ter- 
natives may have a more or less valid connection with the key word. In some cases, the 
correct choice differs from the others only in the degree to which its meaning comes 
close to that of the key word. Vocabulary had a mean loading of .80 on the verbal com- 
prehension factor in two studies noted in French (1951)- 

No adequate " paper and pencil test of the ability to retain a large quantity of 
information could be found. Tests of short-term memory are available, but the profes- 
sional, administrative, and technical jobs included in this study were adjudged to 
require long-term memory. Therefore this ability was not included in the test develop- 
ment plan. 



RESULTS AND DISCUSSION 



Ratings of duty impo r r.an c e a nd t: ime > Subject m^itter experts rated the importance 
and time spent for eacl'< duty Tn their occupation in the manner described earlier. 
Appendix B contains rrt{5:ins nnd standard deviations of importance and time spent ratings 
for t?ach duty :*or ench occ.ip/i ion . Number of SMK raters is indicated for each occupa- 
tion. Inspection of App(MKii\' B suggests that duties varied considerably within occupa- 
tions in both importance anci lime spent. This suggests the i^aters undertook their 
tasks seriously and mad-:? ve 1 1-reaGoned judgments, as halo and inflationary rating ten- 
dencies are not appari^it. 

As might be expected, occupations with greater numbers of duties tended to have 
lover average ratings than did occupations with fewer duties. That is, the greater 
the number of duties, thf less important any single duty tended to be, and the less 
time.spent on it. The correlation between number of duties in the occupation and mean 
importance rating was -."'O. This relationship makes it improper to attribute any sig- 
nificance to differences in AT values between occupations. AT values appear to be 
^ useful -in this study only to ascribe relative weights within occupations. 

Reliability estimates were obtained by computing product moment correlation coef- 
ficients bctwen mean ratings of randomly selected halves of the rating groups. Correla- 
tions were corrected by the Spearman-Brown prophecy formula. Table 4 lists reliability 
coefficients, for subject matter expert ratings of duty imporeance, duty time spent and 
KSAO importance. All but f i\ e of the 81 coefficients reached s ta t is tical ' signi f icanco . 
This is especially remarkable in view of the small numbers of duties in many of the 
occupations. In fact, tl^.ere were six duties in each of the two oAQupations in which ' 
nonsignificant coefficients (p > ,05) occurred for both importance and time spent 
-ratings. In the occupation where the other nonsignificant coefficient was obtained 
there were seven duties. These results indicate that the SME ' s understood their tasks 
and rated from a common frame of reference. The duties and KSAO's were well defined 
and carefully rated. 

The relation of duty importance to relative amount of time spent was explored by 
correlating mean SME ratings of these variables. Table 5 lists these correlations for 
the 27 occupations. Twenty-five were statistically significant (p < .0'^), Most of - 
the CO relations were of high magnitude, fully 20 of them above .90. This very strong 
relationship between importance and time suggests the measures can be. used interchange- 
,'ably. This finding supports the position of Christal (1974) that time spent ratings 
can be used in task analysis systems. According to Christal, relative time spent ratings 
are preferable to duty importance ratings in calculating degree of similarity between 
positions. 

. R a t ing o f ab i 1 i t ies proposed for the written test , The psychologist ratings of 
the six abilities proposed, for the written test were to be combined with Sl\c. ratings of 
duty importance and time spent to provide the basis for weighting test parts. Table 6 
presents reliability estimates of these ab i 1 i t y r a t ings . The coefficients were obtained 
by dividing the six psychologists into two equal sized groups, c a 1 cul a t ing the correla- 
tion of the mean ability ratings over the duties in the occupation, and correcting for 
a double-sized group by- the Spearman-Brown formula. 

The psychologists appear to have rated the abilities quite reliably, especially 
in view of the snail number of raters, the difficulty in making the required inferences. 
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TABLE 4 



Corrected Pearson Product Moment Split-Half Reliabilities of 
SME Rat ing of Duty Impor t ance , Duty Time Spen t ^ and KS.AO ' s 











Reliability Estimates 






No. 


No. 








Series 


Occupat ion 


of 


of 


Impor- 


Time 


KSAO ' J 




^ Raters 


Dut ies 


t ance 






105 


Social Insurance Administration 


68 


20 


97'-^- 


98** 


98** 


110 


Economist 


40 


12 


91--* 


94** 


97**' 


180 


Ps;^cho logy 


9 


10 




84** 


89** 


187 


Social Services 


16 


6 


71 


48 


94** 


201 


Personnel Management 


77 


16 


96** 


96** 


98** 


334 


Computer Specialist 


, 73 


11 


96*^'V 


95** 


97** 


343 


Management Analys is 


60 


13 


92** 


91** 


98** 


526 


Tax Technician 


53 


9 


98** 


98*-* ' 


98** 


560 


Budget Administration 


69 


14 


92** 




96** 


570 


Financial Institution Examining 


20 


9 




95** 


95** 


685 


Public Health Program Specialist 


20 


6 , 


43 


77 


94** 


962 


Contact Representative 




7 


96** 


98** 


9 7 ** 


967 


Passport & Visa Examining 


16 


7 


13 


90** 
99 A 


81* 


993 - 


Social Insurance Claims Examining 


78 


10 


96** 


98 ^v* 


996- 


Veterans Claims Examining 


40 


8 


94** 


86** 


95** 


1081 


Public Information Specialist 


25 


10 


74* 


94** 


93** 


1,082 
1102 


Writing & Editing 


30 


9 


86** 


86** 


95** 


Contract & Procurement 


58 


8 


94** 


97** 


98**. 


1169 


Internal Revenue Officer 


71 


'ir 


99** 


100** , 


98** 


1710 


Education & Vocational Training 


39 


16 


94** 


96*.* 


^ 95** 


1712 


Training Instruction 


40 


6 


9 7** 




98** 


1810 


General Investigating 


36 


8 


100** 


9S 


96** 


1811 


Criminal Investigating 


60 


14 


92** 


98** 


97** 


1816 


Iitimigrat ion Inspection 


36 


6 


88* 


~ 98'^ 


97 ** 


1854 


Alcohol, Tobacco, & Firearms' Inspection 


34 


10 


94** 


9 4** 


9 7** 


1890 


Customs Inspection 


68 


10 


84** 


95**' 


97** 


2001 


General Supply 


65 


,19 


95** 


95** 


94** 



;>]ote. Decimal- points have been omitted. 
* p £ .05 
** p £ .01 



17 



TABLE ^5 



Correlations Between Mean SME Ratings of 
Duty Importance and Re lat ive Time Spent 



Series Occupation , Duties Correlation 



105 


Social Insurance Administration 


20 




98^^ 


ilO 


Econom i^ t 


12 




88** 


180 


Psychology 


10 


\ 


91** 


187 


Social Services 


6 


\ 


99** 


201 


Personnel Management 


16 


\ 


99** 


33A 


Computer Specialist 


11 


\ 


98V5r* 


3A3 


Management Analysis 


13 


\ 


. 98** 


526 


Tax Technician 


9 




\ 98** 


560 


Budget Administration 


14 




\ 95** 


570 


Financial Institution Examining 


9 




91** 


685 


Public Health Program Specialist 


6 




82* 


962 


Contact Representative 


7 




94~^ 


967 


Passport and Visa Examining 


7 




54 


993 


Social Insurance Claims Examining 


10 




95** 


996 


Veterans Claims Examining 


8 




92** 


1081 


Public Information Specialist, 


10 




94** 




Writing and Editing 


9 




99 ** 


1102 


Contract and Procurement 


8 




^0** 


1169 


Internal Revenue Officer 


11 




93^-* 


1710 


Education and Vocational Training 


16 




96**. 


1712 


Training Instruction 


6 




35 


1810 


General Investigating 


8 




95** 


1811 


Criminal Investigating 


14 




83** 


1816 


Irm^igration Inspection 


6 




80** 


1854 


Alcohol, Tobacco, and Firearms Inspection 


10 




70* 


1890 


Customs Inspection 


♦10 




94** 


2001 


General Supply 


19 




99** 


Note- 


Decimal points omitted. 








* P 


< .05 


# 


r 




p 


< .01 
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TABLE 6 



Corrected Pearson Product-Moment Split-H^'f Reliabilities of 
the Means of the Psychologist: Ratiuj^s of Abilities 



Series 


Occupat ion 


' Duties 

! 


Deduc- 
tion 


Induc- 
tion 


4J 

r. 

n 
W) 
n3 


Memory 

1 


C\ 


Verbal 
Compre- 
hension 


105 


Social Insurance Administration 


20 




74** 


73** 


48* 




74** 


ilO 


Economis t 


12 


74*-'V 


9 l*Vr 


96** 


89** 


80** 


92** 


180 


Psychology 


10 


51 


92** 


64* 


95** 


83** 


85** 


187 


Social Services 


6 


74 


-22 


58 


00 


93** 


95** 


201 


Personnel Management 


16 


74** 




82** 


62** 


86** 


67** 


334 


Computer Specialist 


11 


75*^ 


65* 


76** 


91** 


26 


88** 


343 


Management Analysis 


13 


9 2*'* 


6 7* 


90** 


91** 


82** 


75** 


526 


Tax Technician 


9 


82*^ 


44 


88** 


60 


88** 


89** 


560 


Budget Administration 


14 


84** 


41 


81** 


35 


67** 


91** 


^570 


Financial Institution Examining 


9 


89*--^ 


96** 


87** 


77* 


94** 


93** 


685 


Public Health Program Specialist 


6 


69 




90** 


92** 


95** 


98** 


962 


Contact Representative 


7 


87** 


89** 


92** 


87** 


90** 


92** 


967 


Passport & Visa Examining 


7 


81* 


96** 


95** 


92** 


74 


68 


993 


Social Insurance Claims Examining 


10 


91** 


73* 


90** 


78** 


87** 


81** 


996 


Veterans Claims Examining 


3 


7?*- 


63 


88** 


88** 


84** 


70 


1081 


Public Information Specialist 


10 




31 


96** 


67* 


90** 


77** 


1082 


Writing & Editing 


9 


80** 


45 


81** 


69* 


98** 


91** 


1102 


Contract Procurement 


8 


-13 


73* 


75* 


74* 


92** 


81* 


1169 


Internal Revenue Officer 


11 


76** 


90** 


81** 


56 


95** 


91** 


1710 


Education & Vocational Training 


■ 16 • 


67'^ 


68** 


84** 


89*^v 


80** 


88** 


1712 


Training Instruction 


. 6 


85* 


92** 


95** 


88* 


85* 


-56 


18J0 


General Investigating 


8 


95** 


, 72* 


97** 


70 


92** 


94** 


1811 


Crimin£'.l Investigating 


14 


81** 


88** 


48 


86** 


40 


95** 


1816 


Immigration Inspection 


6 


68 


86* 


88* 


63 \. 


91*- 


76 


1854 


Alcohol, Tobacco, & Firearms Inspoc 


. 10 


69* 


80** 


94** 


82** 


91** 


85** 


1890 


Customs Inspection 


10 


88*--^ 


41 


88** 


87** . 


91** 


84** 


20ni 


General Supply 


19 


73** 


15 


69** 


64** 


86** 


87** 



Note, Decimal points omitted. 



* p < .05 
** p j< .01 



19 



o 

ERIC 



\ 

and the tedium of the task. It should be recalled that the six raters became familiar 
with the jobs through the use of classification standards. They were each required to 
make 1710 separate ratings, that is they rated six abilities for each of the 285 duties 
of the 2". occupations. Of the 162 reliability coefficients, 13A reached statistical 
significance, The median value* of the J 62 coefficients value was .84, 

Development of test weig ht s for occupati ons • The subtest weights in Table 7 were 
dev?.loped by application of Equations ( i ) and (2) and the rounding procedure described 
in the Method Section- 0<^<:upat ions are ordered in the table according to similarity of 
weighting pattern* St-ven categories accounted tor all 27 occupations studied* Since 
memory could not adequately be measured, the first two categories shown collapsed into 
one, leaving six categories C:u cover the 27 occupations. Category A includes fifteen 
occupations; Category B, eight; and the remaining catej^ories, one each. 

In the classification system for General Schedule occupations, series number 
digits to the left represent the group of occupations in whi':h a particular occupation 
belongs. For example, the 560 series (Budget Administration) belongs to the 5, or 
Accounting and Budget, occupational group; the 1811 series (Criminal Investigating) 
belongs to the 18, or Investigation groupo ^Generally, this research found that occu- 
pations in the same group had the same weighting pattern. Abilities received weight.^ 
of either two or one, with the exception of a weight of three for the verbal compre- 
hension ability for the Writing and Editing occupation. 

In order to provide another view of the way the*, jobs tend to cluster according to 
patterns of AI which they might share in common, an iterative factor analysis with an 
orthogonal varimax rotation procedure was carried eat on the intercorrel at ion matrix of 
the ability importance values,- This analysis was inade across the six weighted constructs, 
that is, correlations in the matrix were based upon ^=6. Factors were then interpreted 
using factor loadings, communal.ities , and percentages of variance accounted for by each 
factor. Table 8 shows the results of this factor analysis. Five significant factors 
factors were extracted, accounting for a total of 100 percent of the variance in the 
factored matrix. All th^^ variance was accounted for because there were five degrees of 
freedom and five factors. The factor analysis, therefore, could not properly be used to 
test hypotheses. The values were based on mean ratings and were, therefore, quite stable. 
It is recognized that the factor analysis cannot be considered statistically strong.^ 
However, the analysis can be useful in describing the way these occupations tended to 
group together in comparison with the ability weighting patterns. Because all variance 
in the factored matrix was accounted for in the five factors, all commonality values 
were 1.00, Obviously no items would be omitted in subsequent factor analyses. 

The factors were named according to guidance provided by Harman (1967, p, 133): 
"The coefficients of a factor pattern indicate the correlations of the variables with 
*:he respective factors and furnish the basis for naming them," and "The investigator 
is guided by the magnitude of the factor weights in the selection of appropriate names 
for the factors. The name selected is usually suggested by the nature of the variables 
having the largest correlations with the factors under consideration^ This nam'^ 
should be consistent with th^^ nature o^f the remaining variables which have low corre- 
lations with the factor," : actor names are considered arbitrary. They are generally 
necessary in research such as this for understanding the nature of the factor. 



The factor analys is> star ted with ones used as first estimates of communal it ies , 
The matrix was refactored a number of times; first, until the number of significant 
roots had been decided, then until the diagonal estimate had stabilized, that is, the 
sum of squares of the factor loadings for a variable fell within ,02 of the diagonal 
value in the factored correlation matrix (Buhler, 1973). 
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TABLE 7 

Rounded We ight s of Abi 1 i t ie s by (>at: ion 



Series 


— . _ , , — 


1 

1 Deduction 


Induction 


1 

Judgment 


Memory 


Number 


Verbal 


1 

OJ 

2* 

Q 


henslon 


•7 m 
ZU i 


Personnel Management 




2 


2 


2 






2 




96 7 


Passport & Visa Examining 




2 


2 












993 


Social Insurance Claims Examining 


2 


2 


2 


7 






2 




17 19 


Training Instruction 


z. 


7 










2 




1 U 1 fi 
i 0 i U 


General Investigating 


7 


<i 


7 


2 










1 Q 1 1 


Criminal Investigating 


2 




2 


2 


1 




7 




i 0 1 0 


I mm igration Inspect ion 


2- 


2^ 


2 


2 


1 




2 




i 0 y u 


Cus t om s Inspection 




n 
z. 


'J 

z. 


2 






2 




1 n 


Social' Insurance Administration 


2 


2 


2 








7 

z. 




187 


Social Services 


2 


2 




[ 


■ 




2 




343 


Management Analysis 


2 


2 


2 








2 




685 


Public Health Program Specialist 


2 


2 


2 




[ 




2 




996 


Veterans Claims Examining 


2 


2 


2 








2 




1081 


Public Inf orroat ion Specialist 




2 


2 








2 




1710 


Education & Vocational Training 


0 
z. 


2 


2 








2 




liO 


Economist 


n 

L. 


2 


2 




2 




2 






P sy cbi 0 1 ogy 


7 


2 


2 




2 




2 




526 


Tax Technician 




2 






2 




2 




560 


Budget Administration 


7 


2 


2 




2 




2 




570 


Financial Institution Examining 


7 


2 


2 




2 




2 




1102 


Contract Cx Procurement 


9 


2 


2 




7 




2 




1169 


Internal Revenue Officer 


2 


2 


2 




2 




2 




200 1 


.General Supply 


2 


2 


2 




2 




2 




334 


Computer Specialist 


2 


2 


2 


1 


2 




i 




962 


Contact Representative 


2 




2 


0 


1 




2 




1082 


Writing 6f Editing 


2 


sl 


2 


2 


1 




3 




1854 


Alcohol, Tobacco, & Firearms Inspection 


2 


1 


2 


2 


2 




2 





>> 
u 
o 

00 
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No grouping of jjbs was hypothesized, so these factors, made up of jobs, are 
viewed purely in an investigative frame of reference. 



Factor 1 . Table 8 shows the loadings on the first factor. l^.xs factor accounted 
for 49.5 percent of the total variance. The following occupations, with their grade 
revels and factor loading, are representative of the factor: 



Edi. ational and Vocational Training (9) ,96 

rersonnel Management (13) .96 

Public Information Specialist (13) .96 

Passport and Visa Examining (10) .95 

Writing and Editing (12) .94 

Training Instruction (9) ,94 



The factor appears to have classified jobs together which have verbal, nonquant i tat ive 
aspects in common. Analysis of duties of these occupations suggests the name for this 
factor: Individual and organizational examining, training, and analysis . 

Factor 2 . The second factor shovm in Table 8 has loadings which croup jobs having 
quantitative applications in common. It accounted for 28.4 percent ofzhe total varian. 
accounted for by the analysis. Typical jobs loading highly on this factor x^ere; 



General Supply (9) .95 

Tax Technician (9) .94 

Contr-^ Tnd Procurement (12) ,92 

Budget -iGministration (13) ,88 

Internal Revenue Officer (12) ,87 

Financial Institution Examining (12) ,83 



Because of the quantitative nature of the work, and the additional common denominator 
of fiscal and material accountability, this factor was titled: Quantitative application 
to fiscal, material, and re search requirements . " " 

Factor 3 , This factor accounted for 10.3 percent of the total variance. Impor- 
tant jobs loading on it were: 



Computer Specialist (12) ,99 
Economist (14) ^58 
Psychology (13) .58" 

Management Analysis (12) ,46 



This appears to be a research and analytical factor with ^ significant social component. 
The factor was named: Systematic research and analysis . The lesser loadings and bi- 
polarity (See Table 8) emphasized a social aspect of those jobs. 

Factor 4 , A fourth factor, representing 5.9 percent of the variance, grouped the 
f 6 1 lowing jobs : 



CustomsInspection(9) ,57 

Criminal Investigating (13) ,56 

Internal Revenue Officer (12) ,41 

Immigration Inspection (9) .36 

General Investigating (11), .35 



The inspection, investigation and enforcement aspects of these jobs provided the obvi 
factor name: Inspect ion , investigation , and enforcement. 
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TABLE 8 



Variraax Factor Analysis Performed on Weighted Construct Ratings 
for 27 "Job Samples, Giving Jobs Identified by Series 
Factor Loadings and Comiunalit ies with Accompanying 
Sunmarv Information about Contributions to Variance 





Series 




Factors 


and 


Communa 1 i t y 








and 












,2 
h 




Job Sample 


Journeyman 
Grade 


^1 


^2 


^3 


^4 






Education and Vocational Training 


1710-09 


96 


23 


07 


06 


10 


1 . 


00 


Personnel Management ? 


0201-13 


96 


03 


1 4 


19 


14 


1 , 


00 


Public Information Specialist 


108 1 -1 3 


96 


26 


-02 


03 


10 


1 , 


00 


Passport and Visa Examining 


0967-10 


95 


-0 5 


1 & 


25 


03 


1 , 


00 


Writing and Editing 


10S2-12 


94 


13 


-30 


04 


06 


1 , 


00 


Training Instruction 


1712-09 


94 


-1 3 


-2 5 


-18 


-0 5 


1 , 


00 


Immigration Inspection \ 


181 6-09 


89 


2 1 


0 / 


36 


13 


1 


ou 


Public Health Program Specialist 


0685-1 3 


8 9 


4 1 


04 


00 


18 


1 

i . 


uu 


General Investigating 


1810-11 


o o 

OO 




7 9 


35 


-19 


1 


UU 


Social Insurance Claims Examining 


0993-10 


8 6 


28 


2 6 


08 


32 


1 , 


00 


Social Insurance Administration 


0105-10 


o c 


4y 


-U J 


1 - 
- i :> 


1 1 
1 1 


1 


UU 


Management Analysis 


O /i '5, — 1 1 


ft T 

o J 


9 Q 




-08 


06 


1 • 


fin 


Contact Representative 


0962-09 


83 


-31 


-44 


-07 


15 


1 . 


00 


Criminal Investigating 


1811-13 


81 


-03 


16 


56 


03 


1 . 


00 


Veterans Claims Examining 


0996-12 


80 


37 


13 


25 


39 


1 . 


00 


Customs Inspection 


1890-09 


6 5 


31 


-0 5 


57 


40 


1 . 


00 


Social Services 


0187-07 


64 


59 


41 


26 . 


-04 


1 . 


00 


General Supply 


2001-09 


-06 


95 


-12 


-03 


28 


1 , 


00 


Tax Technician 


0526-09 


03 


94 


26 


20 


10 


1 . 


00 


Contract and Procurement 


1 102-12 


27 


92 


-21 


-14 


-13 


1 . 


00 


Rudget Administration 


0560-13 ' 


-18 


88 


17 


-30 


25 


1. 


00 


Internal Revenue Officer 


1 169-] 1 


24 


87 


04 


41 


16 


1 . 


00 


Financial Institution Examining 




41 


83 


20 


20 


26 


1 . 


00 


Psychology 


0180-13 


18 


79 


c 


-0 7 


-0 2 


1 . 


00 


Economis t 


0110-14 


20 


76 




12 


"17 


1 . 


00 


Computer Specialist 


0334-12 


-03 


11 


99 


04 


1 I 


1 . 


00 


Alcohol, Tobacco, Firearms Inspec 


. 1854-09 


41 


36 


08 


07 


83 


1, 


00 



Percent Contributions to Variance 49.5 28.4 10.3 5.9 5.8 

Cumulative Percent 49.5 ;7,9 88.2 94.2 100.0 



Note. Decimal points are omitted for all entries in the body of the Table, The 
number of weighted construct ratings for each job in the sample was» 6. 
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I'^ac tor 5 . The fifth factor nad the weakest array of factor loadin^i; and ac^ . . . 
5.8 percent of the accountable variance. Table 8 shows one loading to be viry hi^;h, 
three others to be weak but supportive: 



Alcohol, Tobacco, and Firearms Inspection (9) »83 

Cuscoms Inspection (9) .40 

Veterans Claims '^^amining (12) .39 

Social Insurance Claims Examining (10) ,32 

Few jobs would be expected to fall into a category such as this. Study of the duties 
and responsibilities oi hese occupation,^ suggest, the name: Monitoring and servicing. 

It was not expected tha the gro- ng of the jobs by factor analysis would match 
the grouping arrived at by t e othe ,nethrd. The great majority of jobs would probably 
group into a few categories /here a standard weighting would be applied* Other jobs 
'■ Id group into a few oth . categories where the required weighting systems would be 
son^ewhat unusual, and at times, unique. Jol^ s commonly group this way, even when other 
aspects of the job are used as a basis for grouping. 

A factor analysis of the typ_ shown in Table 8 provides a cross check of the 
groupings of jobs with the same ability weighting patterns. A factor analysis was 
applied to the .same data underlying the weighting patterns to determine whether an 
objective grouping could be obtained using an independent methodology. As can be seen 
in a comparison between the weighting patterns in Table 6 and t' g factor loadings in 
Table 8, there was perfect agreement between job s in \5cc upa t iona 1 category A. All had 
their highest loadings on Factor 1. Every job in occupational category B loaded .76 
or higher on Factor 2. Comput-^r Specialist, the only job in occupational category C, 
loaded only on Factor 3; a very logical factor in terms of the requirements of the ^ 
other jobs loading on that lactor. Contact Representative, a job requiring personal 
interactions-, and the only job in occupational category D, had a high loading on Fac- 
tor 1, but also had negative loadings on Factors 2 and 3. It is less quantitative 
and analytical, and this is reflected in the lower w^eights on number and induction. 
The Writing and Editing job was in a unique weighting category because of the high 
verbal comprehension requirement as compared to inductive reasoning requirements. 
Alcohol, Tobacco and Firearms Inspection had its own abilities weighting pattern, and 
had the highest loading in Factor 5. 



Interestingly, 16 of the 27 occupations shown in Table 8 loaded above .30 on more 
than one factor. The occupations loading on one, two, three, or four factors are 



Four 



shown below: 






One 


Two 


Three 


1710 


V Qh7 


962 




1.816 


996 


10 


685 


18 7 


10^:^ 


1810 


1854 


1712 


993 




2001 


105 




526 


343 




1 102 


1811 




.33A 


560 






1 169 






570 , 






180 






110 





1890 
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Exaraina ti :;n of Table 8 reveals a logical correspondence between jobs loading on various 
factors anu the knoum requirements of the occupation. At times, loading on more than 
one factor indicates jobs of a m.ore complex nature. Some factors reflect more complex 
job requirements than others; therefore, an analysis of job complexity must involve 
a review of the nature of the factors as well as their number. Also, jobs can involve 
a number of factor activities, but at lower levels of those activities. At any rate, 
the loadings suggest the proper emphasis of abilities within occupations. A job such 
as Public Information Specialist load;; only on the verbal factor, ( F -, ) , as the duti'is 
of the rnajority of those positions loading on that factor would suggest. On the orher 
hand, the occupation of Customs Inspector loads on the verbal (F|), quantitative (Fo), 
inspection/enforcement (F^), and service factors (Fc;). The duties of the position 
"^require interaction with the public, inspection, seizure, arrest, import duty calcula- 
tion, and learning of many regulations. Again, this diverse activity is nof at the 
highest levels of sll fa'jtors, but the diverse natu. - of the occupations is revealed 
by the factor analysis. 

The categorization of the occupations makes sense in ten ^ of factor names which 
v;ere assigned to them. 



( 1 ) 


Indt-vidual and organization 


e::. 'mining , trai ni 


L ng , and analys is . 


(2) 


QuantitaiivG application to 


fiscal, material 


, and research requ irem.en t s 


(3) 


Systematic research and ana 


lys is . 




(4) 


Inspection , investigation , 


and en force me nt. 




(5) 


Monitoring and servicing. 







These groupings could possibly have been obtained without formal analysis. They 
do not violate present knowledge of j ob ca tegor iza t ion , and c :iu conveniently be used . 
for reference to job groupings having unique requirements. 

Ratings of KSAO's. Reliability coefficients for the ratings of the importance 
of each of 31 KSAO' s for overall job performance were presented in Table 4. The mag- 
nitude of these coefficients indicates that the interrater reliability was high for 
all rater groups . 

Appendix C lists the mean rating of each KSAO for each occupation as well as the 
overall mean and standard deviation for each KSAO. Fully seventeen of 31 KSAO's were 
rated very important across £lll 27 occupations; that is, mean ratings over the 1241 
SME's were 5.0 or higher. Ten were considered important (^4.0), and four were of some 
importance {>3,0). All of the KSAO's were therefore considered to be of at least some 
importance for the occupations. \^/hile there was variation from occupation to occupa- 
tion, the ratings .trongly suggest that the KS.AO' s are relevant to occupations covered 
by the PACE. Since the KSAO's were rated v;ith respect to overall job performance it 
was not possible to relate them to specific duties. 

It was considered important to determine \<;hether the 31 KSAO's could logically be 
consolidated into fewer, more general groups. It was hypothesized that the reduced 
number of more general KSAO's would corroborate the six constructs rated by the ^p-sy;- 
chologists. A second iterative tac'tor analysis was therefore carried out using the 
mean ratings of the 31 KSAO's by SME's. This analysis was done across the 27 jobs in 
the sample; that is, correlations in the input matrix were based upon /7 =27. Table 9 
shows the results of the factor analysis. Eight significant factors wert. extracted. 
They accounted for 83.7 percent of the variance in th^ factored matrix. Communal i t ies 
ranged from .52 to .99, indicating that in subsequent analyses none of the abilities 
need be omitted. 



Notice, that: eight o: th(5 fir:t ii KSAO ' s listed in Table 9 are noncognitive or 
personality''vnr inblc'S niu: 17 the last 20 are cognitive variables. The fact-r a>.<. 
ysis confirms thi^- distinction since the two sets of variables generally load ii "Hi f- 
ferent factors. The only exceptions to this are factors 2 and 3 which have both co'gi 
tive and noncognitive components. 



Fac tor 1 . 

interpreted as 
on this factor 



Th e first tact' 
an "interact ini: 
are: 



■r, wiiich contributed 21.1 percent of the variance, was 
v;Ltli peopl--" factor. The abilities which loaded highly 



De'al witli People 
Emo t ion a 1 Ma t ur i t y 
Tac t 
Empathy 

Oral Communication 



.95 
.87 
.87 
. 75 
. 75 



The factor appears to have classified r^bilities together which call for relating with 
people on jobs. Table 9 also shows Listening, Persuasiveness, Self Control and Force- 
fulness as having high loadings on this factor. The title for the important ability 
reflected by this T^ictor was: Ability to influence a nd work considerately with others; 
to interact as a developed, mature employee . The ability was not related to any of the 
ability constructs measured by the PACE. 



Factor 2 . The second factor accoui: 
It was a factor emphasizing keenness, or 
typify the factor: 



?d for 11.5 percent of the total variance, 
jercept iveness , and the following abilities 



Ob'iect Perception 
Physical Stamina 
Alertnes.j 
Integrity 
Per sever anc e 



.95 
.77 
.63 
.59 
.51 



This factor was considered related to the ability construct of induction as defined, 
in this research. It emphasizes the examination of s pec if ic. data , recognizing 
relationships, and solving problems. The title for this factor is: Mental and physical 
alertness to perceive important aspects of the work environment. 

Factor 3 . This factor represents 11.2 percent of the total variance and is in- 
terpreted as an innovative planning factor.' The following abilities are typical of 
those loading on the factor: 



Or ig ina 1 i t y 
PI ann ing 
Cur io s i t y 

Qu a n t i t a 1 1 v c Re a s o n i n g 



,94 
.90 
.63 
.48 



Sel f Control 
Memory 



-.32 
-. 32 



This factor was seen to relate to the ability construct of deduction which emphasizes 
-thinking clearly about the app 1 ica t ion o f principles and developing a system, plan, 
or procedure. It was titled: Planning and executing original and exploratory work> 
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TABLE 9 



Varimax Factor Analysis Performed on Ability Ratings by Subject 
Matter Experts Giving Abilities, Factor Loadings 
and Communal i ties with Accompanying S^ummary 
Information about Contributions to Variance 



Factors and Communality 



Abilities 


^1 


f 2 


F3 


^4 


'^5 


^6 


F7 


^8 


h^ 


Deal with People 


95 


10 


-07 


-05 


-20 


02 


07 


-02 


97 


Emotional f'laturity 


87 


13 


-12 


-22 


-11 


05 


16 


15 


91 


Tact 


87 


29 


-31 


08 


-09 


06 


G 


04 


96 


Empathy 


75 


-19 


05 


07 


35 


-21 


-0<' 


33 


89 


Oral Communication 


75 


08 


09 


-11 


08 


-02 


02 


-02 


60 


Listening 


71 


24 


-11 


08 


-20 


05 


27 


33 


81 


Persuasiveness 


68 


10 


36 


21 


12 


49 


-08 


-21 


96 


Sell Control 


65 


■■-44 


-32 


-04 


-06 




40 


-04 


89 


Forcef ulness 


55 


21 


36 


03 


23 




-13 


-2:> 


94 


Object Perception 


02 


95 


03 


05 


25 


06 


05 


-09 


99 


Physical Stamina 


28 


77 


10 


-16 


-IS 


02 


01 


18 


77 


Alert 


52 


63 


20 


10 


-15 


04 


34 


-03 


85 


Integrity 


39 


59 


-05 


05 


-09 


43 


-05 


14 


72 


Memory 


18 


49 


-32 


13 


41 


18 


43 


15 


80 


Originality 


-10 


03 


94 


16 


07 


10 


03 


04 


95 


Planning 


05 


-02 


90 


-15 


-05. 


06 


25 


04 


90 


Curiosity 


00 


34 


63 


10 , 


-41 


20 


Z4 


18 


82 


Grammar 


-01 


-05 


01 


97 


-04 


03 


00 


06 


94 


Spelling 


14 


14 


- ] 


87 


09 


-16 


26 


04 


93 


Written Communication 


-19 


-09 




79 


^01 


24 


-09 


00 


85 


Quantitative Reasoning 


-25 


20 


43 


-30 


63 


09 


-04- 


-32 


93 


Reading Comprehensicm 


"26 


10 


-05 


55 


62 , 


14 


08 


02 


78 


Letter Writing 


10 


-17 


-08 


-06 


61 


21 


22 


-11 


52 


Fund of Information 


02 


20 


-18 


37 


57 


40 


19 


24 


78 


Judgment 


14 


26 


04 


, -06 , 


12 


83 


19 


15 


86 


General Reasoning 


-1^ 


-09 


34 


13 


34 


76 


-0? 


09 


88 


Attention to Detail 


-12 


07 


13 


. 10 


41 


10 


'J 


-30 


77 


Adaptability 


40 


03 


05 


05 


16 


-02 


rv3 


-02 


59 


Perseverance 


16 


51 


30 


19 


-12 


32 




-03 


89 


Objectivity 


36 


10 


02 


-02 


02 


23 




84 


90 


Arithmetic Computation 


24 


-05 


-25 


-25 


20 


-01 


26 


-57 


62 



Percent Contributions 

to Variance 21.1 11.5 11.2 10.3 8.5 8.2 7.1 5.8 

Cumulative Percent 21.1 32.7 43.9 54.2 62.7 70.9 78.0 83.7 



Note. Decimal points 'are omitted from factor-loadings. The number of subject 
matter expert ratings for each ability was 27. 



\ 
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Factor 4 , Factor loadings of the fourth factor indicated ths presence of a ver- 
bal factor. It ^ac^ounted for 10.3 percent of the variance. Abilities typical of 
those loading on tKis factor were: 

Grammar , 9 7 

Spelling ,87 

Written Communication ,79 

Reading Comprehension ,55 

Verbal comprehension was an ability construct used in ' the current riesearch. It empha- 
sized knowledge of, understanding of, and ability to manipulate the English language. 
Tliis factor was titled: Writing, r jading , and general verbal ability . 

Fa££or^. This facto*- appeared to be a general reasoning factor. It accounted 

for 8.5 percent of variance. Of the 3] abilities, the following loaded highly on this 
f ac tor : 

Quantitative Reasoning . .63 

Reading Comprehension • . 62 

Let ter Wr i t ing ,61 

Fund of Information . .57 

Curiosity -.41 

All of above abilities are generally associated with the concept of "intelligence" as 
it is ordinarily defined. This factor V7as titled; Intelligent and knowledgeable 
reasoning ability, .' \ 

Factor 6 . Tne loadings for Factor 6 strongly indicate aWctor of judgment-. It 
accounted" £orv&.2 percent of the variance. Abilities loading on this factor were: 

Judgment / ,83 

General Reasoni. i^ / .76 

Persuasiveness - ,49 

Force fulness / ,46 

Integrity ' .43 \ 

/ , \ 

The ability construct Judgment , used in this PACE research emphasized solving problems 
when some facts are omitted, making reasonable a sumptions , and producing reasonable 

decisions. This factor, which supports the use of a judgment ability in PACE, was 

titled: Al : lity to make and act upon e ffective judgments. \ 

— - ' ' ~ \ 

Fac tor 7 . T: e loadings for the seventh factor in Table 9 highlight the charac- 
teristics of a r oblem solver. It accounted for 7.1 percent of the v^ariance. The 
highest loadings of KSAO's for this factor were: 

Attention to Det<3il . 68 \ 

Adaptability ^63 \ 

Perseverance ,60 \ 

Self Control ,40 

This factor is logically related to goal orients ion and inductive reascining with 
implications for productivity. However, -it is recognized that problem solving is an 
important aspect of most jobs, as was the personal interaction aspect of^^Factor 1.. 
This factor was named: Persistent and adaptive attention to detg^ils of D^he work. 
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Factor 8. Factor S appears to be an objectivicy factor as opposed to a factor 
of qu antitati ve ability. It accounted for 5.8 percent of the variance. Abilities 
loading highly on Factor 8 were: 

Objectivity 

Empathy --^-^ 
Listening . ' ■ 33 

Quantitative Reasoning 
Arithmetic Computation 

This factor is distinctly bipolar and could indicate a sensitive counseling type of 
objectivity apart from anything computational ,or quantitative. It was not directly- 
related to any abilities measured by the PACE: It was named: Empathetic and recep- 
tive objecti vity, vs. quantitative reasoning and computation . 

The factor analysis provided support for four of the six abilities studied in 
this research for possible inclusion in the; PACE. Two of the cognitive abilities 
were faetorially complex; that is, they loaded significantly on a number of factors. 
Quantitative reasoning and arithmetic computation , v/hich would be equivalent to the 
ability number, loade d high on Factors 3, 5, and 8. The complex character, m emory, 
while not emerging as a factor in its own right, was present m four factors as one 
of the KSAO's which had a reasonably high ;loading on each. Table 9 shows memory to 
load significantly on Factors 2, 3, 5, and 7. The characteristics of self control 
and :■ -rseverance are the only other characteristics of the 31 to load signixicantly 
on as many as four factors. 

Th- f;'ctor analysis points up the need for measurement of the ability to inter-_ 
act with people The SME raters consider that many of the noncognitive characteristics 
reflect this one underlying factor. These data indicate the need to develop a valid 
measure of interpersonal skills. Past research has shown it to be a desirable but 
elusive variable to measure. Factor 7 is 'also in^ere=ting in that it relates to induc- 
tion and ^Ho KSAO' ^ 'ncviuji major loadings are characteristics of productive problem 
Solvers. Research is needed to develop measures' of persistence and problem solving 
abil ities . 

The factor analysis supported the six abilities on which a test could be based. 
Four of the abilities emerged as factors in^ their own right. A fifth ability, number, 
is a component of several of the factors, and car. be readily measured. Memory also 
appeared in several factors, but it w not feasible to include it in :-he test. 

Assignment of the remainder of PACE oc cupations to occupational categories . Since 
some 120 occupations meet the PACE scope of coverage requirements, and since the occu 
■ national categories were developed on a sample of 27 of these occupations, itwas nece- 
ssary to ascribe the rerT^aining occupations to categories so that the examination could 
be uced to meet the requirements of the Government. This became a task of the Standards 
Division of the Commission's Bureau of Policies and Standards. Occupational specialists 
in that division are responsible for development of classification and qualification 
standards for all occupations'. The Standards Division developed a plan to obtain 
ratings of SME's to determine duty importance and time spent for their own occupations 
and to obtain ratings of occupational specialists, of the importance of the abilities 
V abilities for performance of duties. Weighting patterns would then be established 
%s with the presen-t study of 27 occupations. As a test of the agreement m ability 
robing between psychologists and occupational specialists, seven occupations rated by 
psychologists were also rated by a group of six occupational speciali.-sts . Only two 
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differences in the weighting patterns were found, and thev could be .-iplained bv -oundin^. 
error. it ^appeared that both group, could rate abilities' -.liably and coi^istentl, 

^,>h tlcT n-easure, i senior occupational specialist who was thorouehlv familiar 

with PACE o^pati.r.s evaluated each remaining occupation in the concext of"tbe five 
connl'in'n ^\^^^^^° ""^^ Occupation into an existing occupational category pending 
corapletion of the more comprehensive approach described above. 



SUMMARY AND PROSPECTUS 



The objectives of the project were met: 

. 1. Five cognitive abilities were identified as being required for successful per- 
formance m the occupations to be covered. These abilities were carefully defined, in 
order to enable analysis ot their relations to performance of job duties. 

r.la;,-/ ^y-n^°'«^i<= method of job analysis, which could provide an assessment of the 
relative importance ot the abilities for successful performance, was developed. Duties 
of an occupation were determined from classification standards and substantiated by 
subject matter experts. The duties were rated for importance and time spent. Psycholo- 
gists evaluated the importance of each cognitive ability for successful performance of 
each duty. These three sets of ratings were mathematically combined to determine tbe 
the relative importance of each ability for the occupation. 

3. A new written test to assess the cognitive abilities was planned and developed. 
Test scores could be weighted m six different patterns, for six differ-^nt categories 
of occupations. ^c^^i. j-ccj 

4 It was determined th^t future research should be directed toward several goals. 
KM assessed to ensure the accuracv with which it measures 

. ^^^^.^^^P^^ - required. Second, the abilities themselves should 

be studied further, withm the to nd on the job, to evaluate their independence. 
Third, means of assessing new abi _es, such as the very important ability to interact 
with people should be developed. .>i-erdCL 

n.^^nn line of research will elaborate the construct validity of the new exami- 

nation. Of major importance to such research are criterion-related validity studies 

^^'^hnicaUy feasible. A plan has been developed and implemented to cirry 
out such studies. These will assess the definitions of the abilities both in' the written 
test and on the job, and the linkage between abilities in the test and abilities on the 
job. They will illuminate the problem of deciding what abilities are required in the 
job and how they may be assessed most appropriately.. They will also substantiate the 
precision of the job analysis method. 
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Thirty-one Knov;lecges, ^Skills, Abrlicies, and Other Characteristics 
Required for Successful Performarce in 
Tventy-seven Occupational Series 



Adaptability 

to be able to deviate froir. routine work methods. The ability to change a long- 
standing work method or a personally designed procedure based on a change in 
circumstances or valid criticism. 

This ability is important when the changes are sporadic and have far-reaching 
consequences 

Alert 

To be prompt to perceive and act; to maintain a constant state of watchfulness. 
Ability to maintain sustained attention to imjnediate happenings. 

This ability is 'mportant when an employee is required to r-nitor signals or 
events and reacu uickly to them. 

Arithmetic C o mputation 

The ability to perfoVm routine arithmetic operations quickly and accurately. The 
ability to quickly and accurately add, subtract, multiply, and divide whole numbers, 
fractions, and percentages, etc- 

This ability is important when the employee is required to p' "orm or check a sub- 
stantial amount of arithmetic operations. 

Attention to Detail . 

The ability to pay attention to many details in designing or implementii. , a system, 
procedure or program so that there arc few or^no unanticipated contingencies. It 
is the ability to handle many details so that 'hey work harmoniously towards the 
desired end. It is also a willingness to become immersed in and challenged by a 
large amount of detail. 

Fund of Information 

The ability to amass, keep current and integrate a large fund of information. The 
employee should have the ability to keep current in a large num.ber of fields of knowl- 
edge.^ The knowledge need not be profound but '^hould satisfy the work requirements 
and should provide a basis for accum.ula t ing mor^ advanced information. 

General Reasoning 

The ability to think clearly in facti:'^', symbolic, or figural terms; to draw the cor- 
rect implications from the stated conditions or produce a plan. 

This ability is important when an employee is required to utilize sufficient but 
complex information to reach a conclusion or produce a plan. 
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/ . Grammar 

Knovledg..- of the structure of voxels and their custor.ary ar.ran.^ernents into sentences. 
Knovledge of the formally accepted conventions vith re.spe.-f.. to the English language. 

This ability is particularly important in coinn.-s i or eciting --.-ricten r-aterial and 
w-her^i a large amoun*: of formal conversatio:^ is renuir'.:d. 

8. J ud gment 

The ability 'oason, using incomplete or conflicting inf ornation . The employee, 
based on giver, mf orination / can in many c.;.ses correctly infer that unspecified events 
have probably occurred or are lil-:ely to occur. The unspecified events are not con- 
pletely determined by the events that are stated, but represent the most likely 
occurrence, based upon 'past experience. 

Thi:^ ability is particularly important where action must he taken on incomplete 
information. 

9 . Letter V7riting X 

The ability to quickly compose clear and concise correspondence relating tu routine 
office matters. The correspondence clearly convevs the intended message. Thp cor^ 
respondence generally deals v/ith routine matters for which somewha:: scrndardized 
procedures have been developed. 

This ability is important when a substantial amount, of time is devoted to composing 
correspondence relating to standardized operations. 

10. Lis ten in 

The ability to obtain oral information; to pay attention to what another person is 
saying in order to obtain needed information. The ability not to intrude with irrel^ 
evant information or not to misinterpret what is bein;:; said. 

11 . Memory 

The ability to retain a large quantity of information. The information need not be 
integrated into related fields of knowledge. 

Tnis ability is important when a large quantity of information must be quickly 
recalled, or where the rei^rence system for storing information is inadequate'. 

12- Ob ject ivity 

To be able to view a situation without the interjection of any personal bias. To be 
able to think clearly about emotional] • laden material. The abilitv to see thincs 
witr.out any personally pror^^^ed distortion. 

This ability is import ant : when the employee is. required to reason. c Learly concerning 
matters in which he has some sort of personal involvem-:int . 

1 3 . Oral Communica tion 

The ability to convey information oially. Tiie employee orally transmits information 
so that others understand what he is saying. Ho can anticipate where his listeners 
might have difficulty in understanding becau c the material is difficult or amb: is 
and he makes the material intelli ^^J.ble, 

Thi^ ability is important where oral information is complex or is routine but must be 
' presented quickly. 
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14 . O rigirialir.v 

The ability to devise new f^Dluticns to problenis; to see connection. jvcen apparently 

unrelated eventj in order to produce an in-proved product. ■ To uncover unusual rel ;- 
tions among items of inf c^T^.-ition instead of the ir.ore co:TtT;Onpl ace . 

This ability is. important in positions *.v*hich iiv/olve the developr.ent of prograt-i. . 

scientific research, nnvi ::';or functions inv:^]viii:; rj;-; sointzion of cjif:'icult ann 
unique problems. 

15. Object Perception 

The ability to note subtle visual cues in objects or fortns; t: ^ b^i able to detect slight 
changes or deviations from the '^sual appearance of objects. 

This ability is especially Important wher-2 the employee io re^: d to scan object:s 
quickly and reach some kind of decision based on their appcr.. . . 

16 . Planning 

The ab i 1 i t y L o design a me t h o d for : o c c i n ;c a desired end. T':": e me t ho d re quires t "n e 

integration of several actions. T:- .:m::lo;,-3e mu;- anticipate ihe possible consequences 

of each of the acts in tn.e series -c.: .mm.od ' • them to th.e desired end result. 

17. Quantitative Reasoning 

^The ability to solve pr~-blem.s by performing complex m.anipulations v;ith quantitative 
symbols. The manipulau ..ons are efficient in eliminating unnecessary steps in solving 
the problem. It is also the ability to solve quantitative problems using alternate 
approaches; in tliis way answers can be c'necked. 

This ability is important when an employee is requi.re^'. to solve comiplex quantitative 
problems where the approach to be utilir^ed is not specified, 

"Quantitative Reasoning" is a special form of "( icral Reasoning'. 

18. Reading Comprehension 

The ability to understand com.plex written materials. It is ti\e ability to read and 
understand written materials quickly, and to retain ::he content for at least a limited 
period of time. 

19 . Spelling 

The ability to form words from letters according to accepted ;h;;;lish usage. The 
written words are correct sin.^o they conform, to common practice. 

This ability is important when written m.aterials are produced in final form.. 

^^'^itt en Comjnunication 

The ability to impart complex information in writing. Th employee pro h.ices writcen 
information so that otht^rs understand the presented mate Lai. The employee can antici- 
pate possible misinterpretations f the written material that he prepp.res and eliminate 
them. 

This ability is important where an employee is responsible for producing complex written 
material that raust be easily understcK^d. 
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21. Curiosity 

A desire to tindp.rRtand the reasons for happenings or behavior. A dissatisfaction 
with superficial or^arbirtary explanations which leads to probing for more basic 
causes of phenomena. - 

/' 

This trait is especially important in research positions and in positions which 
require deep and detailed familiarity in a rapidly changing field or specialization. 

22. Deal wit h People 

The ability to deal with people effectively and equitable, and to be able to work 
with others toward a mutually positive end. The ability to get along with people 
in maintaining a mutually productive relationship. 

23. Emotional Maturity 

To have emotional reactions appropriate to their stimulating conditions and to be 
able to control their expression so that they have productive consequences. To 
react to difficult situations so that behavior is appropriate in effecting a 
desirable change or result. 

24. Empathy 

The ability to see things from the other person's point of view. It is the ability 
and desire of an individual to put himself in another person's shoes in order to 
understand his difficulties. It is an habitual way of reacting in which one is at 
least partially successful in understanding the behavior of others. 

25. Forcef ulness . 

To have enterprise and initiative in interpersonal relations. To be able to advo- 
cate a position, point of view, or opinion despite opposition. To exert influence 
over others. 

2G. Integrity 

The quality of being dependable and not violating a legitimate trust. A person who 
has integrity will discharge his duties so that rules are followed and he conforms 
to the commonly accepted standards of right behavior. Is incorruptible. 

27. Perseverance 

Tne ability to persist in a task, problem, or undertaking in spite of difficulties, 
opposition, or discouragement. A persevering person will not permit difficulties 
to change his productively oriented approach to a task or problem. He attacks his 
work tenaciously until it is completed. 

This ability is important when the work may present many obstacles or distractions 
to successful completion. 

28. Persuasiveness 

The ability purposefully to influence the behavior of others. Can by effort cause 
individuals to^dopt a point of^iew or modify their behavior. The ability to be 
personally compellijig..^P«rsuasiveness is a specific form of forcef ulness. 

29. Physical Stamina 

The ability to expend a great deal of physical energy. The* employee can respond 
with a large amount of physical force and strength. This refers both to a con- 
tinuing requirement for the expenditure of energy or a sporadic use of an extraor- 
dinary amount of physical force. 
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30. Self Control 

The ability to concentrate on the work task at hand regardless of any adverse 
emotional, mental, physical consequences. The ability to stifle nonprorluc tive 
reactions in order to focus on the work to be performed. 

Tb.is ability is important v;here the employee is exposed to provocative or frus- 
trating conditions which could significantly interfere with effective work 
performance. "Self Control" is a more specific form of "Emotional Maturity"* 

31. Tact 

The ability to avoid offense in dealing with people. It is the ability to deal 
with potentially unpleasant interpersonal situations in a manner such as not to 
produce antagonism to "Deal with People" and both are related to "Emotional Matu- 
rity" and Self Control". 
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APPENDIX B 



Means and Standard Deviations of Ratings of the Importance of 
Duties (I) and Time Spent in Performance (T) by Subject 
MaLter Experts in Twenty- seven Occupation5> 





Duty 


Mean 
I 


Mean 

T 


SD 
I 


SD 
T 




GS-105 Social Insurance Administration 


(N=68) 








1 


Administers and/or participates in a public 
information and public relations program 
relating to Federal Social Security programs. 


2.94 


2.31 


2.20 


2 


,08 


2 


. Participates in leadership capacity in com- 
munity activities related to Social Security 
programs . 


1.54 


.99 


1.78 


1 


.26 


3 


Adjudicates Social Security claims. 


4.32 


4.18 


3.11 


3 


.09 


4 


Initially develops ocial Security program 
claims. 


4.21 


4.03 . 


3.25 


3 


.17 


5 


Analyzes Social Security program to assure 
that it meets the needs of the region or 
locality. 


1.71 


1.10 


2.19 


1 

a. 


.79 


6 


Analyzes contractors and/or State agencies 
for performance. 


1.66 


1.54 


2.61 


2 


.41 


7 


Develops and maintains contacts and liaison 
with specific contractors and/or State agency 
personnel. 


1.81 


1.59 


2.50 


2 


.23 


- 8. 


Receives and analyzes beneficiary complaints 
concerning program fraud and abuse. 


3.51 


2.56 


2.16 


1 


96 


9. 


. Supervises employees, forms internal office 
1 policy and establishes relationships with 
other offices. 


2.01 


1.56 




1 


80 


10 


Visits certain classes of providers to explain 
program needs and requirements. 


.1.12 


.84 


1.74 


1. 


46 


11. 


Performs technical analysis and review of 
health insurance-related reports. 


1.96 


1.59 


2.15 


1. 


96 


12. 


Provides technical information and assis- 
tance to district offices. State agencies, 
and Che- public on program matters. 


3.85 


3.47 


2.33 


2. 


31 


13. 


Plans and conducts training programs. 


3.09 


2.25 


1.93 


1. 


69 


14. 


Develops and writes procedural instructions. 


2.45 


2.02 


2.43 


2. 


14 
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Mean Mean SD SD 
Duty I I T 



GS-105 Social Insurance Administration (N=68) (Continued) ■ 



15. 


Coordinates with other elements in SSA and 
other government agencies. 


2. 


56 


2. 


15 


2. 


37 


2. 


09 


16. 


Project management of responsible functions 
for which procedures have been developed. 


2 




9 

^, . 




^ . 




2 . 


08 


1 7 


writes letters, memos , ana aeLaiieu rtipui Lb. 


4. 


54 


4 , 


02 






1 . 


67 


18. 


Designs and revises forms. 


1. 


69 


1. 


27 


1. 


81 


1. 


30 


19. 


Establishes policy based on the laws and 
regulations . 

/ 


1. 


04 




67 


2. 


04 


1. 


45 


20. 


Prepares regulatic^i and manuals. 




52 




39 


1. 


39 


1. 


20 




GS-110 ' Economist 


(N=40) 














1. 


Conducts research into economic phenomena 
tracing cause and effect relations to solve 
practical problems or administer programs. 


4. 


77 


3. 


,85 


1. 


,67 


1. 


.99 


2.. 


Applies professional knov/ledge of economic 
principles and methods to the solution of a 
broad range of practical problems and/or the 
administration of a pro^^ram. 


5. 


.40 


4. 


.67 


1. 


.43 


1. 


.'59 


3. 


Collects and/or interprets economic data. 


5. 


.28 


4. 


.85 


1. 


.22 


1. 


.46 


4. 


Utilizes statistical methods. 


4, 


.10 


3, 


.44 


1, 


.30 


1, 


.80 


5. 


Keeps abreast of latest findings in area of 
specialization and in general field. 


5, 


.35 


3 


.72 


1 


.19 


1 


.61 


6. 


Learns and applies large store of technical 
knowledge to his work. 


5 


.00 


4 


.38 


1, 


.54 


1 


.94 


7. 


Recoimnends course of action or reaches con- 
clusions based on r-^idence that has significant 
impact on theory, or practice. 


4 


.85 


3 


.89 


1 


.64 


1 


.87 - 


8. 


Supervises other economists. 


4 


.42 


3 


.69 


1 


.88 


1 


.92 


9. 


Makes policy recommendations based on economic 
data and analysis. 


4 


.20 


3 


.15 


1 

t> 


.84 


1 


.99 


10, 


Briefs policy officials on economic matters. 


3 


.75 


2 


.56 


1 


.68 


1 


.76 


11. 


Represents agency and U.S. Government with 
respect to economic matters. 


3 


.95 


2 


.51 


1 


.89 


1 


.68 


12.- 


Writes reports for publication. 


5 


.29 


4 


.17 


1 


.35 


1 


.66 
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Mean Mean . SD . SD 





• GS-180 Psychology 


(N= 


= 9) 














i 

1. 


Experiments with organisms to develop laws 
of behavior. 


3. 


56 


2 


.13 


2 


.96 


2 


.59 


2. 


Applies knowledge of psychological principles 
and methods to the solution of a broad range 
of practical problems. 


5. 


33 


5 


.25 


1 


.22 


1 


.28 


3. 


Utilizes statistical methods. 


4. 


78 


3 


.88 


1 


.48 


1 


.96 


4. 


Keeps abreast of latest findings in area of 
specialization and in general field. 


5. 


78 


4 


.25 


1 


.48 


1 


.98 


5. 


Learns and applies large stpre of technical 
knowledge to accomplish work. 


4. 


78 


4 


.63 


2 


,05 


2 


.00 


6, 


Recommends course of action or reaches con- 
clusions based on evidence that has significant 
impact on a theory or practice. 


5; 


00 


5, 


.38 


1 


.73 


1 


.60 


7. 


Designs and conducts research studies. 


5. 


11 ^ 


4, 


.88 


1 


.62 


1 


.73 


8. 


Evaluates research designs. 


5. 


56 


5, 


.50 


1, 


.24 


1 


. ? 


9. 


Designs and conducts educational training 
programs . 


2. 


00 


1 


.63 


1 


.80 


] 


. ■ 9 


10. 


Evaluates educational training programs. 

V 


2. 


11 


1 


.88 


1 


.83 


1, 


.46 



GS-187 Social Services (N=16) 



1. Provides assistance to individuals and ^f amilies 
served by social welfare programs by serving 

as intermediary between client and welfare^ ^ 

agency. 5.75 5,19 1.65 1.87 

2. Investigates and determines clients' resources. 4.50 4.19 2.61 2.68 

3. Determines kind and degree of personal problems 

of client in order to prescribe needed assistance. 4.63 4.25 1.09 1.29 

4. Determines kind and amount of social service 

entitlement. 4.44 3.88 2.42 2.50 

5. Prescribes unique social services where required. 3.13 2.63 1.36 1.50 

6. Modifies social service plan where changes in 

circumstances warrant. 3.13 2.75 1.63 1,77 
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! . . Mean Mean SD SD 
Duty 1 I T I T_ 



GS-2011 Personnel Management ( N^77) 



Develops and/or evaluates personnel regula- 
tions, policies, or programs for one or several 

sub-areas of the total personnel program. 5.16 4.43 1.98 2,16 

2. Implements personnel regulations and programs 
in an operational setting for one or several 

sub-areas of > the total personnel program. 4.55 4.13 2.37 2,44 

3c Participates with operating management in long 
range planning with respect to personnel aspects 

of organization program. 3,83 3.13 2.27 2,30 

4. Advises management with respect to merit prin- 
ciples and personnel management concepts, 4,62 3,96 2.27 2.09 

5. Deals with both management and labor in an 

advisory and adversary relationship, 3,37 2,70 2.47 2.29 

6. Keeps abreast of the latest personnel regu- 
lations. 5.30 4.10 1.67 1.90 

7. Matches applicants with vacancies applying 
knowledge of personnel qualifications, job 

requirements, and merit principles. 2.80 2.34 2.34 2.20 

8. Classifies positions accc^ding to type of work, 

difficulty level, and degree of responsibility. 3.20 2.36 2.64 2.34 

9. Resolves relationship problems existing between 

individual supervisors and employees. 2.95 2.24 2.35 1.93 



10. Advises personnel on human relations in the 
work setting. 



3.12 2,41 2.27 2.00 



11. Advises personnel on employee benefits programs 

and options. 2,14 1.61 1.98 1.72 



12, Represents management in negotiating with 
employee organizations. 

13. Serves as organizational consultant in field 
of employee development and training^ providing 
knowledge of facilities available, permissible 
practices. 



1,92 1.28 2.44 1.82 



2.55 2.05 2.15 2.03 
14. Conducts employee training on selected subjects. 2,57 2.03 1.75 1.50 



15, Determines training needs of personnel and 
arranges for conduct of training, 

16. Develops and/or implements social action 
program, 
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2.61 1.86 2.18 1.68 
5,00 4.26 1.91 1.91 
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GS-334 Co mputer S pecia list (N==73) 
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Writes efficient computer programs using \ . 

specialized computer language. 5.21 4.55 '^.24 2^33 

Develops requirements for computer based 

information processing system. 4. "78 3.78 1.62 l.Us 



3. Tests program to insure that it produces 
desired information within the constraints 

of the information system. 5.99 4.68 1.56 1.68 

4. Corrects incorrect or inefficient program. 5.14 3.59 2.03 1.90 

5. Learns subject matter field in order to 

develop computer applications. 5.08 .3.94 1.42 1.71 

6. Operates computer and peripheral equipment. 1.25 .65 1.33 .91 

7. Develops detailed programs or systems speci- 
fications and related documentation. 5.15 4.29 1.83 2.03 

8. Provides training for trainee programmers. 3.51 2.43 2.05 1.74 

9. Coordinates with users/customers, and other 

organizational levels. 5.12 4.09 1.27 1.65 

10. Assists in developing the Logic for data 

systems. 4.65 4.18 1.49 1.70 

11. Evaluates equipment utilization and makes 
recommendations for increasing efficiency 

of operations. 2.24 1.71 1.89 1.61 



GS-343 Management Analysis (N=60) 



!• Develops and improves the effectiveness of 
work methods and procedures by applying 

management tools and techniques. 4.43 3.90 1.60 1.64 

2. Analyzes and evaluates the effectiveness of 

work methods and procedures. 4.72 4.18 1.39 1.57 

3. Keeps abreast of latest technical findings in 
field of management analysis in order to. perform 

duties. 4.25 3.15 1.47 1.46 

4. Recommends changes " in management operations 
that have significant impact on organization 

and its personnel. 4.45 3.62 1.73 1.87 
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Duty ^ 
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. GS-3 43 M anagem ent Analysi s (N"60) (Continued) 



5. Consults with operating management both in 
adversary and advisory capacity. 

6. Thoroughly learns the functions and specific 
activities of the organization to be analyzed 
in order to perform duties. 

7. Administers management improvement programs. 

8. Recomraendn changes in operating policies, 
plans, ar ' objectives. 

9. Participates in design of management systems. 

10. Develops management tools. 

11. Develops and conducts training programs in 
field of management analysis. 

12.. Keeps abreast and applies knowledge of com- 
puter processing. 

13. Serves as troubleshooter when management 
problems arise. 



4.78 4.10 1.47 1.54 

5.38 4.50 1.57 1.77 
2.68 2.00 1.50 1.56 



4.65 


3.95 


1. 


63 


1.73 


3.78 


3.17 


1. 


,62 


1.66 


3.22 


2.85' 


1. 


,74 


1.78 


2.77 


1.98 


1. 


.58 


1.36 


4.07 


3.34 


1 


.92 


2.17 



4.80 4.07 1.86 1.87 



GS-526 Tax Technician (N=53) 



6.66 6o53 .88 1.05 



1. Examines tax returns to verify their conform- 
ance with Internal Revenue regulations, some- 
times involving personal contact with taxpayer. 

2. Applies knowledge of elementary accounting 

in order to perform duties. ^-92 4.28 1.80 1.57 



3. Interprets precedent cases with respect to 
their relevance to the case under investigation, 

4. Reaches decisions on substantive issues in 
tax returns o 

5. Decides on best way to conduct examination; 
involves subtle distinctions in line of 
questioning. 



5.25 4.43 1.30 1.60 
6.42 - 5.72 .93 1.54 

6.06 5.25 1.13 1.70 
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Duly 



GS-526 Tax Technician 



6. Assists t^payer in preparation of returns 
during filing session. 

\, 

7. Answers taxpayers* inquiries involving tax 
planning and complex research issues. 

8. Classifies and selects 'etums foV examination. 

9« Guides new tax auditors in technical and 
procedural problems. 



Mean Mean SD SD 

I T I T 



(N^53) (Continued) 



3.7A 2.81 1.70 1.82 

3. AO 2.A5 2.18 2.00 

A. 83 3.AA 1.62 1.71 

A. 27 3.06 1.56 1.8A 



GS~560 Budget Administration 



(N=70) 



8. 



10. 



Makes budget estimates for organizational 

component. 3^97 3^57 2.38, 2.37 
Presents budget estimates to responsible 

Federal officials or to Congressional committee. A.3A 3,23 2.A7 2.17 
Determines allowable funds after funds have 

been appropriated. 3.99 3^23 1.75 1.65 

Develops a system of management controls over 

the obligation and expenditure of funds. 3.93 2.86 2.03 1.80 
Maintains a system of management controls over 

the obligations and expenditure of funds. 4,50 3,78 1.98 2.06 
Simultaneously works on present and future 

^^^g^^s. 5,12 A, 79 1.59 1.A9 

Modifies budget allocations based on actions 

taken by Bureau of Budget and by Congress. A, 31 3.12 2.05 1.81 
Coordinates budget of diverse operating 

programs. 4,11 3.57 2.83 ' 1.82 
Develops budget compilation and review 

process. 4.63 A. 20 1.82 1.95 

Critically analyzes and reviews proposed 
budgets to highlight issues for review and 

analysis by decision makers. 5.36 A. 76 1.90 1.98 

2.57 2.18 2. AO 2.56 



11. Supervises other budget personnel, 
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Duty 



Mean 
T. 



Mean 
T 



SD 
I 



SD 
T 



nc.^S6Q BudPPr Administration (CoHEiSHSlL 



12. 



13. 



14. 



Critically analyzes and reviews proposed and 
pending legislation to highlight issues for 
review and analysis by decision makers. 

/ 

Reviews agency rules , /programs , and statis- 
tical fortns to determiine conformance with 
executive program. / 

Develops public information and relations 
material. / 

I 



\ 



4.15 



3.77 

\ '2.96 

\ 



3.31 

3.15 
2.32 



2.32 



2.34 



2.26 



GS-hlO Financial Institution Examininpx \ (N=20) 



2. 

3. 



Plans and performs examinations of f .ancial 
institutions in order to determine financial 
condition and/extent of compliance with 
regulations./ . 

Applies accounting knowledge. 

Deals with/individuals in financial insti- 
tutions in order to obtain cooperation. 

/ 

Decides whether some malpractice occurs and 
prescribes corrective steps. 

/ 

Applies specialized knowledge of real estate, 
agricultural, small business, economic conditions, 
or otl^er factors affecting institution examined. 



7. 
8. 



Improvises special examining procedures where 
star/dard procedures inadequate. 

Sei'ves as working leader for a team of examiners. 

/ 

Ir/vest:igates applications for branch offices, 
n4w banks, relocation, and mergers. 



9. Evaluates competency of bank management. 



6.30 
4.15 

5.00 

4.80 

5.55 

4.35 
5.20 

4.50 
6.00 



5;90 
3.50 

4.35 

3.40 

5.45 

2.95 
5.15 



.86 
.81 

.97 

1.10 

1.19 

.93 
1.11 



2.90 1.15 
5.30 ^1.03 



GS~ 685 Public Health Program Specialist 



(N=2Q) 



2.28 

2.29 
2.04 



Advises on or conducts studies relating to 
community public health needs. 

Applies knowledge of medical, financial, 
statistical, and legal procedures. 



4.50 



5.00 



3.70 
4.70 



1.05 
1.38 



1.33 
1.05 

1.69 

.1.43 

1.32 

1.19 
1.53 

1.59 
1.53 



1.53 



1.45 
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Duty 



Mean 
I 



Mean SO SD 

■ T I T 



publi c Health Pro^^ram Specialist: 

5.00 



Advises on best tactics to overcome logistic, 
medical, or legal obstacles. 



(N=2Q) (Continued) 



4.60 1.34 i.lO 



Develops programs which motivate groups and 
individuals to take appropriate health action. 

Meets and deals with professional and political 
groups and individuals in order to further ' 
program objectives. 

Provides information and advice on require- 
ments, policies, and procedures for obtaining 
Federal grants. j 



5.0C 4.70 1.59 1.38 



5.55 4.90 1,00 1.74 



4.95 4.00 1,23 1.52 



GS-962 Contact R epr esentati ve 



(N=40) 



Explains and advises on benefit provisions 
of^egulations and procedures. 

Learns applicable rules, regulations, and 
procedures; must know them in depth. 

Assists public in preparing forms and 
applications. 

Motivates clients to follow prescribed 
procedures . 

Represents claimants in both formal and 
informal appeals before rating boards. 

Has broad knowledge of city. State, and 
Federal agencies' benefits and other community 
resources. 

Discusses benefits before pri/ate and public 
groups, appears on radio and TV, and conducts 
orientation lectures. 



6.32 
6.32 
6.02 
5.65 
4.35 



5.82 
5.80 
5.85 
5.38 
2.42 



5.22 4.72 



.86 



1.07 
1.25 
1.73 

1.27 



1.20 



.92 1.26 



1.41 



1.25 



1.95 



1.50 



5.10 



3.30 



1.19 1.77 



GS-967 Passport and Visa Examining (N=16) 

5.75 4.50 1.81 1.97 
4.88 2.25 2.39 



1. Issues passports and visas by applying statutes 
relating to citizenship and natiohality. . ^ 

2. Adjudicates loss of citizenship and nationality 
by applying appropriate statutes. 5,50 
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Duty . I T I T 



GS~967 Passport and Visa Examining (N=16) (Continued) 



3. Applies broad knowledge of previous and still 
applicable citizenship laws, domestic relations 
-^laws, and foreign citizenship laws in order to 
issue passports and visas* 6.25 5.9A .86 , '/ J 

A. Grants recognition of citizenship. 5.80 A. AO 1.7A 1.68 

5. Keeps abreast of 1. ^st laws relating to 

immigration and U.S. and foreign citizenship. 6.AA 5.63 .81 1.36 

6. ExamineiS documentary evidence relating to 

appaicants' identity and birth. 5.67 A-80 1.91 1.82 

7. Drafts correspondence relating to citizen- 
ship and visas. 5.53 5.60 .83 .99 



GS-993 Social Insurance -Claims Examining (N=78) 



1. Develops ,/ examines , adjusts claims for retire- 
ment, survivor, or disability banefits, health 

insurance, supplemental security income. 6.53 6.11 .71 1.26 

2. Adjudicates and authorizes claims for retire- 
ment, survivor, or disability benefits, health 

insurance, sup 'emental security income. 6.62 6.39' .69 1.11 



6.21 5.59 1.01 1.31 



3. Learns and applies laws and implementing 

regulations for social security and/or rail- 
road retirement insurance programs. ^ 

A. Learns and applies other pertinent legal 

matters relating to domestic relations, descent, 

and distribution of property. 5.17 A.A9 l.AO 1.53 

5. Interprets and applies law in diverse circum- 
stances and prepares special determinations on 

complex questions of fact and law. 5.27 A. AO l.AA lr7A 

6. Researches legal interpretations and precedents. A. 92 3.72 1.57 1.72 

7. Applies lay medical knowledge with respect 

to disability claims. 2.90 2.19 2.05 1.89 



8. Participates in training. A.A5 3.15 1.76 1.35 

5.11 3.9A 1.23 1.63 



9. Examines corporate, partnership, and individual 
tax returns. 



10, Develops evidence, medical and lay, in order to 

develop and determine proper 'payees . 5.AA 3.83 1.10 1.A7 



APIM-NMM X n (Continued) 



Mean Mean SI) SD 

^-^^"3^ I 1' I , X 



GS-996 Vecerans Claims Kxaminin^-: (N=40 ) 



1. Develops, .examines, adjusts claims filed in 
connection with vetaranVs benefits by veterans, 

cheir dependents and beneficiaries. 5.10 4.57 1.45 1.75 

2. Adjudlcate^d and authorizes claims filed in 
connection with veterans benefits by veterans, 

their dependents and beneficiaries. 6.63 6,15 .67 1.19 

3.. Learns and applies laws and implementing regu- 
lations for veteran's benefits and insurance 

programs. 6.42 5.70 ,98 1.29 

4. Learns and applies other pertinent legal 
matters such as domestic relations, descent, 

and distribution of property. 4.72 4.05 1.43 1.47 

5. Interprets and applies veterans entitlements 

in wide range of circumstances and claims. 5.85 5.40 1.35 1.37 

6. Refers to interpretation and legal precedents. 3.40 4.40 -1.24 1.45 

7. Acquires lay medical knowledge with respect 

to disability claims. 4..95 4. 72 1.88 1.85 

8. Acts as a member of a hearing panel where 
veteran or/claimant may preset ^. evidence in 

behalf of his claim. 4.57 2.90 1.48 1.69 



GS-1081 Public Information (N=25) 



1. Organizes and presents to interested parties, 
infprTnation about the work of the Gpvernir.ent 

j^ncy. 5.28 4.72 1.65 1.84 

2. Participates with management in deciding how 
the agency and the public can best be served 

through the public information program. 3.72 2.84 2.34 1.75 

c? 

Si 

3. ' Writes 'and edits material used in public 

information progran. "^.16 5.20 1.52 1*. 61 

4. Determines the best way to further the agency 

program through the use of the information media. 4.24 3.36 1.92 1.87 
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Works with organized outside groups in order 
to present agency program. 3.72 3.17 1.49"* 1.76 
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■ i i.c In: or!::;H 



Cont i r.i:ed ) 



6. Anticipates adverse reactions and plans O.m 
best way to, further the work of an agency 
through : use. of information media. 

7 SuD er\'' i s e s and t r a i n s 1 ov e r g r ad c emp lo y e o 5 



2.92 1.93 ■ 1.32 



8 . Researches and a r. --i lyze s s \i b i e c t ma 1 1 e r 
materials . 

9. Keeps abreast of communication tec'-iniques. 

10. Writes contract specifications and mc:;itor 
contracts . 



^^.36 3. 68 1.68 1, 70 
.^0 2,96 1.04 1.27' 



2. ;o 



1. 33 



.01 1.56 



GS-1082 Writing and Edic i ng • (N^29) 



Writes and edits verbal material vhich appears 
in publications or reijorts to the information 
media . 



2.19 



23 



\ 



4. 
5. 



Acquires information about di'.'erse subjects 
about vhich writing and editing;. 

De- .jlops material appropriate to the ^-ro^^p 
""or vhich designed. 

Conducts and edits radio intervievs. 

Adapts and/or trans.l ^tes material for foreign 
audiences . 



6.2(j 

5. AO 
1.37 

2. A 7 



5. 67 

A. ^77 
.87 

..17 



1 . 2A 



2.08 



1.52 

2.03 
1.41 



3.01 2.7A 



6. Researches and obtains already published 
material for dissemination or republication. 

7. Plans format, typography, and illustrations 
for publication. 

8. Reviews manuscripts for conformance vith 
department policy, 

9. Researches and writes speeches. 



3.90 

A. 55 
2. A 5 



3. 31 

3.55 

3. 73 
2.36 



2.27 2.25 



2. OA 1.92 



2.25. 
2.73 



2.10 
2.69 
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APPENDIX B I. Continued) 



Duty 



Mean 

T 



SD J SD 

I y T 



GS-1102 



Contract and Procurement 



2. Negotiates vith business and industry repre- 
sentatives to agree on terms of contract 
and/or price, 

3. )Aj:ialyzes current market and price trends. 

4. Analyzes cost and price elements in contracts 
to determine equity. May require extensive 
contact with contractor, 

5. Signs or prepares final agreement committing 
government to settle or procure material 
and/or services, 

6. Contracts and procures new merchandise for 
which there are no or few precedents, 

7. Acts as team leader in administration of 
contract , 

8. Administers the terms and conditions of the 
contracts to see that the government's 
interest is protected. 



5.71 

6.31 
3,52 

5,53 

3,35 
4,16 
4,12 

4,98 



1. Arranges to purchase materials ^rMvU?r services 
by applying s-atutes, regulations, de'aisions,/ 
directives, and procedures for procurement^^ 



5.05 

5,26 
2,88 

4,66 

2,2 : 
3,76 
3,53 

4,28 



1,45 

1,01 
1,60 

1,06 

2,79 
1,95 
2,30 

2,06 



1.61 

1,47 
1.79 

1.45 

2.31 
2,07 
2.30 

2.18 



GS-1169 



Internal Revenue Officer 



(N=71) 



Deals with delinquent individual and business 
taxpayers in an attempt to obtain payment. 

Investigates business books to determine whether 
taxes are due. 

Decides whether business is insolvent. 

Imposes penalties and invokes administrative 
and judicial remedies to collect taxes; 
e.g., may seize property. . 

Takes testimony under oath. 



6.65 

4.96 
5.30 

6.41 
3.24 



6.42 

4.03 
4.42 

5.66 
2.41 



,61 



,89 



1.25 1.44 

1.39 1.54 

,89 1.39 

1.56 1.35 
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:VPPI:ND1a B (Continued 



Dutv 1 T !- 



ERIC 



GS-iIb9 Intiernal Revenue Officer (::=7r) (Continued) 



6. Applies knowledge of bookke^rping and accounting 

and specific business practices and conditions. A. 91 A.A2 1.43 1.58 

7. Conducts full complia: ce of tax laws. 6.2A 5. 65 .96 1.49 

i. , Inst TV c t s a n d - ■ ; i s t s in t t* .:i i n i n g ]. o* r g r a ci e 

personnel in ^^ries 1169. ^ -'. 79 3.r.3 1.35 1.87 

y . Acts as group manager as required. 4.24 3.04 1.89 1.82 

10. Deals with sophisticated attorneys and 
accountants in resolving the most complex 

and sensitive cases of large dollar amounts. 6.48 6.08 .73 1.15 

11. Has full responsibility to make independent 
decisions to determine what course of action 

would best serve the government's interests. 6.71 6.46 .61 .93 



GS-1710 Education and Vocational Training (N=3 9) 

1. Teaches elementary and secondary school classes 

by applying professional educational knowledge. 2.97 2.59 2.82 2.91 

2. Performs other professional duties in the 
education field; e.g., as guidance counselor, 

club advisor, or school principal. 2.72 2.18 2.18 1.93 

3. Maintains discipline in classroom. 3.41 2.46 2.69 2.36 

4. Confers with students and in many cases 

parents on students* progress. 2.85 1.67 2.37 1.94 

5. Keeps abreast of literature affecting areas 

of specialization. 5.08 3.87 1.78 2.05 



Keeps track of pupils' progress and unique 
needs . 



3.87 3.( ■ 2.46 2.34 



Develops curricula and/or lesson plans based 
on educational practice and subject mcr^tGr 

knowledge. 4.38 3.67 2.40 2.43 

Reviews, evaluates, and critiques course 

materials for instructional adequacy. 6.03 5.^4 1.33 1.67 

Establishes standards for materials to be 

used in extension course programs, 4.62 3.64 1.76 1.86 
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10. Develops and issues ' dci ines rel::Civ- 
t:he?:;e standards and r^.. luvc- 
CO s carte:: I'd s . /. . :o ^.26 i.61 2.05 

:i. Rcvrito v-r cr-y . ::. ^r. 

for revcrding. 5.7 9 5.26 1.2 2 1.60 

L2. Assures that visual aids, including ill;:s- 

trations and scheir.atics , are consistent witi: 
textual d i s c u s s i. o n s , and r e '/ i ev; i t en^. s ; a d ex n n i - 
nation items are adequately correlateo viuh 

these for instructional purposes, 3.62 4.92 1.11 1,74 

13. Answers student rrespcnden::c ^^:'■aLin.- l^^ 

instructional aid:-:. 4.29 3,08 1.68 2.07 

14. Coordinates and consults vi:.;: ^^..rs- .n'i:hors, 
their supervisors, and otiier subject rrianter 
specialists on probler.s relati.r-r: tc in'oj.;r ar- 
ming, preparation, a:~l dcvelo:-~ent of cou: .>2 

naterials. 5.26 3.87 1.37 1.79 

15. Pveviews and evalu. js ':atistical data relrv Lng 

to instructional aids a: . reconrn^ends revisions. 4.97 4.03 1.91 2.08 

16. Constructs original test itens as necessary. 4.95 3.69 1.92 2.20 



GS-1712 _ _T raining Instruc tion (N=4Q) 



ERIC 



1. Teaches classes by applying pr ■ r.ical knowl- 
edge of educational principles. 5.57 5,70 1.13 1,09 

2. Is a subject matter expert in a technical 

field. 5.72 " 3.13 1.20 2.61 

3 . Deve 1 op s c: u r r i c u I : m, t r a 1 n 1 n ■ : , and ] o h 

aids based upon knowledge o ' ochnical f ield 

and teaching environment, 4.17 3.4 3 1.11 1-38 

4. Prepares and g.vades examinations in sub :ts 
taught in order to assess students andi le 

effectiveness of his teaching. 4.82 3.60 ,93 1,39 

5. Keeps abreast of literature and new devel.- 

ments in subject matter field taught. 5.38 4.30 .98 1.59 

6. Keeps track of students' progress, counsels 

them, and modifies instruction to conform to ^ 

student characteristics. 4.97 4 '25 1.33 1.66 

\ 



^ Du:;.- : ]■ I T 

GS-lol' ' .1 : : i to r I •.■vii criil.- j 

1. Plans and :orduc:s in\'es t i:.;^r: ic:^-: pe rt i:; ii;/ 
Co persoi: character, suitability of ;V'tsor^ 
or orgaritat ior.- :"or ?eder"l bc:;-jflt:- 

etiT.: icy:::-:, t . - . ■■' . - ..r-- 

2. Prepares verb::' a:td vritten repor . : of f iT:.f lni;>^ , 6.03 3,33 1.13 1.38 

3. Intervievp individuals in order tc ur. zovcr 

facts, 3c -its and obtains cooper a u _ , 6.19 5.86 1 . OA 1.31 

A„ Connects clues as a result of clsnar:^Le 

evidence v. .d research. 5.b^/ --,93 1 . 2A 1,63 

5. beams rules and re;;ul.itions n^'" a 1 n i to 

tvpe of investigations nerforn:e.. 5,f^7 4.1-i i.Al 1,97 

6. Works with othei' fnves t i.^:a tors in ::iv:r, 

situations. 3.31 2.6:. ]..S0 2.10 

7 . \lo r ks closely w i tb. the 1 e a 1 s t a f f in prep 
ration of cases and ser^oes as experr witness 

as required. " 2.9A 2.47 2.77 2.67 

8. Prepares detailed schedules cin.d/or c':nir:- 
based on docunen.ts oh tainted durine; tb.c 

investigation. 3.17 2. 86 2.96 2.77 



GS-lbll 



i- nve st ig atot (Cr ii ?.inal) 



(N=60) 
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1. Plans and conducts inves t i ;L;a t: ions relating; 
tc suspected violations of criminal law. 



] .31 



Learns and applies rules o: ovidei-ce arid 
cour t procedures , precedent court d e c i s ions , 
constitutional i-iv^bts, t^rinina: la^^■s . etc. 



3 . e 3 



1.45 



Uncovers, recocn i r os , deve'ons, an..: ;vu':--onts 
evidence that r ecot:st r nets events and es t ab 1 i s!it:s 
relationships and lei^al • : ib i i i : f '.'s . 



.04 



1.15 



.amtains surveillance arid p^!:n >r:-:- .^n; 
cover v;ork. 

Interviews andi i.nter re, nates in. ' i vi.du.rl; 



8 7 
,58 



3.83 
A. 58 



1. 35 

1 .19 



1.60 
1. 38 



5 



6^ 

5 3 



;vPPE>;DIX B (Continued) 



>! e a Mean S D S D 

1 T T T 



GS~1S11 investigaccr (Criniinal) (?:^6Q) (•Continued') 



6. Works with other investigators in team 

situations. 4.90 4.54 1.28 1.41 

7. Prepares verbal and \rr.itten reports, some- 
times testifying in cc^jrt, X'.07 5.02 . - S 1.16 

5. Develops, controls, and directs sources or 

information. 5.1"" 4.22 . 98 1. 33 

9. Arrests violators, and/or seizes contraband 

and illegal merchandise. 5.57 4.03 1.57 1.94 

10. Conducts searches of persons, places, or 

thinj^s with and without warrant. 4.92 2.92 1.59 1.53 

11. Super-v^ises other Criminal Investigators. 3.92 3.20 2.23 2.17 

12. Coordinates with other agencies and prose- 
cuting attorneys. 4.97 3.29 l.I^ 1.13 

13. Makes recommendations to prosecute or not 

to prosecute. 3.08 1.54 3.48 1.66 

14. Provides armed protection in potentially 

hazardous situations. 5.15 2.62 1.46 .96 



GS-1816 Immigration Inspection (N=36) 



1. Inspects and examines individuals and their 
credentials with respect to their right to 

enter the country. 6.47 5.72 .91 1.55 

2. Detains questionable individuals suspected 

of attempting illegal entry. 6.00 3.74 1.15 2.11 

3. Learns and applies immigration and naturali- 
zation laws. 6.25 5.15 1.42 1.75 

4. Reports findin5?;s botr orally and in written 

form to designated authority. 5..:. 3.81 1.33 1.79 

5 . Adjudicates applications and petitions for 

various benefits under immigration laws^ 5.' 5.22 1.29 1.74 

6. * Performs research and interpretation of laws 

to solve individually presented problems not 

falling into s tandard or common solutions . 5. 06 3»73 1.30 1.53 
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Mean ?P SD 



GS-185A . '^ coholy Tobacco, and Firearrr.s inspection (N-3 3) 



1. Inspects alcohol, tobacco, and firearms 
producers and importers to assure coiTipli i-nce 

with applicable governinent regi:lations . ^,6^ 3. 82 2.57 2. A 7 

2. dits business records. 5.A2 5.03 1.06 1.15 

3. Leams and applies relevant rules and regu- 
lations for industry regulation. 5.97 5.06 .92 1.39 

, Learns and applies production, distribution, 
and other relc" ant practiccG for industry- 

and establishinents regulated. 4.78 ^ .03 1.68 1.90 

5. Inspects eKplosiv. nianuf acturers , dealers, 
users, and importers to insure compliance 

with applicable Federal lavs and regulations^ '■■ . ^0 2.rO 2.54 2.19 

6. Inspects alcohol dealers and users and fire- 
arms dealers to insure compliance with appli- 
cable Federal laws and regulation's. 4.67 4.15 2.54 2.54 

Conducts original investigations to determine 
eligibility to engage in alcohol, tobacco, 

firearms, or explosives industries. 5.36 3.24 2.85 2.25 

8. Perform.s supervision of distilled spirits 

plant operations. 4.45 3.55 2.55 2.36 

9. Conducts investigations of claims filed by 

industry members. 4.61 2.94 2,61 2.08 

10. Trains less experienced inspectors and/or 

examiners (on the job training). 5.13 3.53 .74 1.13 



GS~1890 Customs Insoection (N=68) 



Inspects cargo and luggage being imported 

and exported to collect applicable duty. 6.29 5.97 .92 1.13 

Learns and applies knowledge of regulations 
and procedures concerning the examination, 

classification, and assessment of merchandise. 6.18 5.50 1.02 1.44 

Makes judgment as ':o whether to hold merchan- 
dise or charge individuals who violate customs 
or otlier lavTs with fraud or just collect 

additional duty. , 5.74 4.07 1.23 1.55 



ERIC 



SD 



GS-1390 



( Con c inued ) 



4. Collects duties and ta:>:es on merchandise 
importied for personal use or for cors'r.ercial 
use entered on an infonnal entrv. 

5. Verifies that cargo is truly and correctly 
invoiced and that the. description is aderuate 
for classification and value determination. 

6. Is responsible for maintaining n\axir:um security 
of all areas where imported and exported m-^rchan- 
dise is held in customs custody. 

7. Examines preliminary entrance and clearance 
of incoming vehicles, vessels, aircraft, and/ 
or railroads requiring the presentation of a 
proper customs m.anifest. 

8. Examines aircraft, vehicles, cargo, luggage, 
and persons entering the U.S. in order to 
detect and seize narcotics and other pro- 
hibited merchandise. 

9. Learns and applies knowledge of laws and 
regulations of other Government agencies 
(Federal, State, and local) concerning restric- 
tions and prohibitions of imported merchandise 
and articles. 

10. Testifies in court as required and aids Customs 
Agency and/ or U.S. Attorney xn preparation of 
fraud, pilferage, nnd narcotics cases. 



6. AO 



5.53 



6.29 



5.39 



5.19 



^.26 



6.04 



4.32 



3.87 



5.66 



4.63 



3.81 



1.10 



.81 



1.18 



1.36 



.81 



1.12 



1.38 



, 90 



1.56 



1.58 



1.22 



1.80 



GS-2QQ1 General Supply (N:=64) 



1. Plans and coor dinates m.aterial purchase and 
distr ibuL :• <">n actions to assure properly 

phased support- 3.55 3.30 2.57 2.49 

2. Reviews, validates, and revises basic data 

and decision rules of autc lated supply systems. 4.23 3.60 2.05 2.08 

3 . Determines supply requirements . 3.25 3.06 2. 60 2.65 

4. Plans the distribution of material among supply 

stations and/or contractors. 3.20 2.95 2.31 2.34 

5. Determines amount of funds required for 

material procured- 2.59 2.09 2,37 2.07 
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r.S-.-OOl General Supply (::=t (Continued' 



6. Prepares recommendations for the procure- 

men-: of material. 2.83 2. AS 2.45 2.23 

7. Develops material control program. 2.83 2.59 2.32 2.33 

8. Utilize.:- kno^- ledge of HDP p ocecure^ 3rr_ 

applications. 4.72 4.34 1.82 1.99 

9. Utilizes knowledge of the tecr '.cal features 

and uses of items of material. 3.94 3.63 2.1^ 2.07 

10. Utilizes -/aowledge of the rel ^onship of 
procurement, fiscal, transport:atiou, and 

srorage activities. 4.38 3.90 1.82 2.05 

11. Maintains effective personal contacts in 

coordinating the supply distribution system. 4.63 4.-^8 1.83 2.03 

3. Performs technical or managerial work con- 
cerned with physically receiving, handling, 

storing items v;ithin a distribution system. 2.30 2.09 2.13 2.08 

13. Plans and designs standardized packages to 
protect material between the time of purchase 

and use. 1.05 .86 1.79 1.45 

14. Utilizes knov/ledge of transportation manage- 
ment aiij m.aterials handling equipment. 2.56 2.30 2.13 2.06 

15. Provides standardized description and cate- 
gories for material supply catalogs. 2.13 1.78 2.19 1.99 



16. Utilizes knowledge of systems for cataloging 

and classifying material. 2.69 2.48 2.22 



2 ■ -7 



17. Maintains accountable records. 3.69 3.66 2.79 2.83 

18. Coordinates with foreign and/or domestic 

customers on supply and technical problems. . 80 4.54 2.27 2.42 

19. Analyzes supply performance and other related 

reports. ^ ^.69 4.50 2.31 2.21 
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APPENDIX C 



Mean Importance Ratings of Knowle-.,ges , Skills, Abilities^ 
and Other Characteristics for Each Job Series and 
for All Job Series Corr.bined 



KSAO'S Job Series 





105 




10 


18Q'_ 


187 


201 


334 


34 3 


526 


5J 


SO 


570 


685 


Adaptability 


5.4 


5 


.0 




, 4 


5.5 


5.4 


5.1 


5 . 


4 


s 






.2 




, 9 


5.S 


Alert 


4.5 


4 


.6 




A 


4.9 


4.9 


4.8 


A 


c 
o 


D . 


9 


5 


. 1 


A 


9 


5.6 


Arithmetic Computation 


4.0 


2 


.5 


2 . 




4.9 


1.9 


3.7 


•5 

J . 


Q 




u 


4 


.7 


J « 


Q 


3.6 


Attention to Detail 


5.4 


4, 


.2 


A 




4.6 


4.8 


6.3 


-J . 


9 


D . 


9 


5 


.2 


A 


A 


4.9 


Fund of Information 


5.6 


4 


.9 




o 

, O 


4.3 


5.4 


4,8 


A 


Q 


c: 

J • 


o 
O 


5 


.0 




• L 


5.4 


General Reasoning 


5.6 


5 


.9 




Q 

» y 


4.9 


6.1 


5,9 


D • 


Q 


C, 

O • 


J 


5 


.7 


U 1 


■ X 


5.7 


Gr antmar 


4.9 


5 


^ 1^ 


4 , 


0 


4 . 6 


5.3 


4,1 


D . 




A 


O 

c 




, 7 


D 1 


n 
1 u 


4.6 


Judgment 


5.4 


5 


.8 


-J 1 


9 


5.1 


6.2 


5.3 


-) . 


U 


c. 

0 . 


A 


5 


. 7 




. Ij 


5.9 


Letter Writing 


4.4 


3 


. 9 


A 




4.1 


4.: 


3.8 


/, 

H . 


7 


/, 


D 


4- 


.1 




. U 


4.6 


Listening 


6.0 


4 


. 6 


c 

D . 


> z 


5.9 


5.L 


5.2 


c 

D . 


/ 


0 . 


Z 


5 


. 3 


5 . 


/, 


5.8 


Memory 


5.3 


4 


.0 


J . 




4.5 


4.7 


4.6 




D 


D . 


Z 


4 


.9 


^ < 


c, 
, u 


4.9 


Objectivity 


5.1 


5 


.3 


/: 

D , 


, U 


5.7 


5.8 


4.3 


5 . 


c 
D 


r 

J . 


/ 


4 


.5 


r 

J , 


, 1 


5.4 


Oral C: imiunication 


6.0 


5 


.0 


5 < 




5.3 


5.6 


4.9 


c 




b . 


U 


5 


. 2 


C 

D . 




5.8 


Originality 


4.0 


5 


.4 


4. 


.6 


2.9 


5.1 


5.2 


4. 


6 


4. 


0 


4 


.3 


4. 


. 1 


5.2 


Object Perception 


2 . 2 


1 


.7 


1. 


.9 


0.6 


1.9 


3.0 


2. 


5 


3. 


5 


3 


.4 


2. 


.9 


3.4 


Planning 


4.0 


5 


.2 


5. 


.3 


4.2 


4.8 


5.5 


5. 


,2 


4. 


3 


4 


.9 


4. 


.1 


5.8 


Quantitative Reasoning 


2,8 


4 


. 1 


4. 


.2 


1.1 


2.6 


4.2 


3. 


4 


3. 


8 


3 


.9 


2. 


.8 


3.7 


Reading Comprehension 


5.6 


5 


. 2 


5. 


.2 


4.1 


5.6 


5.3 


5. 


3 


5. 


9 


5 


.0 


4. 


.7 


5.1 


Spelling 


4.3 


3 


.7 


3. 


.3 


4.5 ■ 


4.1 


3.7 


4. 


2 


4. 


5 


3 


.9 


4< 


,2 


4.5 


Written Communication 


4.9 


5 


.7 


-4. 


.8 


4.3 


5,7 


4.8 


5. 


7 


5. 


0 


5 


.0 


5. 


.8 


5.1 


Curiosity 


3.3 


5 


.2 


4. 


.8 


3.4 


4.8 


4.6 


4. 


8 


4. 


3 


4 


. 3 


4. 


.7 


4.5 


Deal with People 


6.0 


5 


.3 


4, 


,9 


6.6 


5.9 


5.1 


5. 


9 


6. 


6 


5 


.7 


5. 


.9 


6.7 


Emotional Maturity 


5.3 


5 


.0 


5. 


.0 


6.1 


5.3 


4.6 


5. 


2 


6. 


0 


5 


.0 


5. 


.0 


5.9 


Empathy 


4.9 


4 


.5 


5. 


, 0 


5.6 


5.3 


4.^ 


5. 


1 


5. 


5 


4 


.7 


4. 


.6 


5.8 


Forcef ulness 


4.1 


4 


.6 


3. 


.9 


3.9 


■ r X 


4.3 


5. 


0 


5 . 


8 


.4 


.8 


4. 


.9 


5.3 


Integrity 


5.5 


5 


.4 


6, 


.0 


5.3 


6.0 


5.1 


5. 


7 


6. 


7 


5 


.5 


6. 


.0 


6.2 


Perseverance 


5.3 


5 


.0 


c 


.1 


5.1 


5.2 


5.8 


5. 


5 


5. 


7 


5 


.4 


5. 


.3 


5.7 


Persuasiveness 


4.0 


4 


.5 


3. 


.3 


3.7 


5.2 


3.9 


4. 


,8 


5. 


7 


4 


.4 


4. 


.8 


5.3 


Physical Stamina 


2.3 


2 


.2 


2 


,9 


2.9 


2.4 


2.6 


2. 


8 


3. 


4 


3 


.6 




.0 


3.5 


Self Control 


5.1 


4 


. 1 


4 , 




6.0 


4.8 


4.9 


4. 


8 


6. 


0 


5 


o 
. ^ 


4, 


.9 


5.3 


Tact 


5.8 


4 


.7 


4, 


.6 


6.2 


5.6 


4.7 


5. 


5 


6. 


5 


5 


.4 


5. 


.9 


6.1 
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KSAO^S Job Series 





962 


9i 


57 


993 


996 


1081 


1082 


1102 


1169 


17: 


10 


1712 


Adaptability 


5 . 


t 


5 


.4 


5.3 


5.0 


4.7 


5.1 


5. 


.0 


5. 


. 7 


5 


.3 


5.1 


Alert 


5. 


2 


5 


.1 


4.1 


4.4 


5.0 


5.4 


4. 


.9 


5. 


. 9 


4 


.7 


4.9 


Arith. Computation 


4. 


6 


2 


.6 


4.8 


4. Z 


2.6 


2.2 


4. 


.4 


5. 


.3 


4 


c 
- ^ 


4.0 


Attention to Detail 


5. 


2 


5 


.4 


5.3 


5.4 


4.7 


4.9 


4. 


. 9 


5. 


.8 


5 


.6 


4.5 


Fund of Information 


5. 


9 


5 


.6 


6.0 


6.0 


5.0 


6.1 


4. 


.7 


6. 


.1 


5 


.0 


4.5 


Gene -^al Reasoning 


5. 


4 


6 


.0 


6.0 


6.0 


5.4 


5.8 


5. 


.7 


6. 


.3 


5 


.6 


5.3 


Gram. ^ 


5. 




c; 


Q 

• K> 


/. -7 
. / 




6.0 


6.4 


/. 


.8 




.0 


6 


.0 


/. o 


Judgir. t 


5. 


3 


6 


.0 


5.8 


6.2 


5.4 


5.2 


5. 


.7 


6. 


.6 


5 


.1 


4.7 


Letter Writing 


5. 


2 


5 


.4 


4.7 


5.3 


3.9 


2.8 


4. 


. S 


4. 


.8 


4 


.5 


3.6 


Listening 


6. 


2 


5 


.3 


4.7 


4.9 


5.7 


5,9 


5. 


.3 


6. 


.0 


4 


.9 


5.3 


Memory 


5. 


8 


6 


. 2 


5.3 


5.4 


4.6 


4.9 


4. 


.5 


5. 


.5 


4 


.4 


4.7 


Objectivity 


5. 


7 


5 


.4 


5.1 


5.] 


5.3 


5.7 


4. 


, 9 


5. 


.8 


/. 


,6 


4.8 


Oral Communication 


6. 


3 


5 


.3 


4.4 


4.7 


5-1 


4.7 


5. 


.4 


6. 


.1 


5 


.5 


6,3 


Originality \ 


4. 


0 


4 


.5 


3.7 


3,7 


4.5 


4.8 


4. 


.1 


5. 


.2 


4 


.9 


4.1 


Object Perception 


3. 


3 


4 


.7 


2.7 


2.7 


2.9 


3.2 


2. 


.3 


4. 


.0 


3 


.6 


3.0 


Planning 


4. 


4 


4 


. 7 


4.1 


3.9 


4.8 


4.4 


4. 


.8 


5. 


.7 


5 


.0 


4.3 


Quant. Reasoning 


3. 


3 


4 


.3 


3.9 


3.2 


2,5 


2.0 


2. 


.9 


4. 


.4 


3 


.7 


3.7 


Reading Coniprehension 


5. 


6 


6 


.1 


6.2 


5.9 


5.5 


6.3 


5. 


.1 


5. 


.8 


6 


.0 


5.4 


Spelling 


4. 


9 


5 


.1 


4.6 


4.6 


5.2 


5.9 


4. 


.1 


4. 


.7 


5 


.4 


4.5 


Written Communication 


4. 


9 


6 


.1 


5»3 


5.1 


6.1 


6.5 


5. 


.3 


5. 


.5 


6 


.1 


5.0 


Curiosity 


3. 


9 


4 


.1 


3.4 


3,8 


4.8 


5.1 


3. 


.8 


5. 


.0 


4 


.1 


4.3 


Deal with People 


6- 


6 


5 


.1 


4.4 


5.1 


5.8 


5.5 


6. 


.0 


6. 


.5 


5 


.4 


5.9 


Emotional Maturity 


6. 


3 


4 


.6 


4.6 


5.0 


5.0 


4.9 


5. 


.4 


6. 


.0 


5 


.0 


5.5 


Empathy 


6. 


1 


4 


.9 


4 = 0 


4.9 


5.0 


5.1 


4. 


.7 


5. 


.1 


4 


.6 


5.1 


Forcef ulness 


4. 


8 


4 


.7 


3.3 


4.6 


4.3 


4.4 


5. 


.1 


6. 


.1 


4 


.2 


4.8 


Integrity 


6. 


0 


5 


.9 


5.5 


5.9 


6.0 


5.9 


6. 


.4 


6. 


.7 


6 


.2 


5.6 


Perseverance 


5. 


5 


5 


.9 


3.3 


5.2 


5.5 


5.7 


5. 


.6 


6, 


,2 


5 


.6 


5.0 


Persuasiveness 


4. 


7 


4 


.4 


3.2 


4.4 


4.4 


4.4 


4. 


.9 


5. 


.7 


4 


.1 


4.6 


Physical Stamina 


3. 


1 


3 


.1 


2.2 


2.9 


3,9 


3.2 


2. 


.8 


-/ I 


.7 


2 


.7 


3.1 


Self Control 


6. 


3 


5 


.4 


4.9 


5.0 


5.1 


5.0 


5. 


.3 


6. 


.0 


5 


.3 


5.3 


Tact 


6. 


5 


5 


.4 


4.6 


5.3 


5.8 


5.4 


5. 


.7 


6. 


,2 


5 


.4 


5.7 



^4 
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APPEl^DIX C (Cor::i.nueG) 



KSAQ'S Job Series 

Mean SD 

All -411 

181" 1811 1816 1851 1890 200^ Series Series 



Adaptability 


5, 


. 7 


5, 


2 


5.0 


5. 


4 


5.1 


5.4 


5.26 


1.33 


Alert 


5, 


.3 


6. 


0 


5.3 


5. 


0 


5.7 


5.2 


5.02 


2.48 


Arith. Conputation 


3, 


.0 


3. 


1 


1.5 


4. 


9 


5.0 


4.6 


3.96 


- 3.49, 


Attention to Detail 


A, 


.7 


5, 


0 


4.8 


4, 


7 


4o6 


5.3 


5.11 


1.93' 


Fund of Information 


4, 


.8 


5. 


1 


5.5 


5. 


1 


5.2 


4.7 


5.27 


1.55 


General Reasoning 


5, 


.6 


5. 


8 


5.6 


5. 


4 


5.1 


5^4 


5.75 


1.24 


Grammar 


5, 


. 2 


4. 


6 


4.8 


5. 


2 


3.9 


4.6 


4.90 


1.59 


Judgment 


5 , 


.9 


6. 


4 


6.2 


5. 


8 


5.5 


5.3 


5.72 


1.39 


Letter Writing 


3 


.3 


3. 


9 


4.5 


4. 


0 


3.4 


5.0 


4.31 


2.01 


Listening 


6, 


. 3 


5. 


9 


5.9 


5. 


5 


5.5 


5.3 


5.52 


1.24 


Memory 


5 


.3 


5. 


3 


5.3 


4. 


6 


5.4 


4.6 


4 . ^8 


1.58 


Objectivity 


5 


.7 


5. 


8 


5.9 


4. 


4 


5.3 


4.7 


9 


2.14 


Oral Gommunication 


5 


.3 


5. 


6 


5.4 


5. 


4 


5.3 


5.2 




1.41 


Originality 


A 


■ 


4. 


7 


3.6 


3. 


5 


4,9 


4.7 




2.23 


Object Perception 


3 


.1 


4. 


,4 


5.0 


2. 


9 


5,4 


3.5 


3.16 


4.20 


Planning 


4 , 


.7 


5. 


6 


3.8 


3. 


8 


4.0 


4.9 


4.70 


2,36 


Quant. Reasoning 


1, 


.9 


3. 


3 


2.8 


n 


9 


3.7 


4.2 


3.43 


3.41 


Reading Comprehension 


4 


.3 


4. 


,6 


5.5 


5. 


5 


5.3 


5.1 


5.43 


1.35 


Spelling 


4 


.6 


4. 


1 


4.4 


4. 


6 


3.8 


4.4 


4,37 


2.00 


Written Communication 


4, 


.9 


5. 


6 


4.6 


5. 


4 




4.9 


5.22 


1.82 


Curiosity 


5 


.3 


5. 


1 


4.4 


4. 


5 


4.6 


4.7 


4.42 


2.78 


Deal with People 


6 


.2 


5. 


9 


6.2 


6. 


0 


6.0 


'5.6 


5.78 


1.44 


Emotional Maturity 


5 


.7 


6. 


0 


5.7 


5. 


4 


5.4 


5.1 


5.32 


1.58 


Empathy 


4 


,3 


4. 


5 


5.0 


4. 


2 


3.6 


4.8 


4.82 


1.90 


Forcef ulness 


- A, 


.0 


4. 


,9 


4.6 


4. 


6 


4.7 


4.6 


4.68 


2.00 


Integrity 


6 


.6 


6. 


8 


6.8 


6. 


3 


6.5 


5.6 


5.98 


1.59 


Perseverance 


6 


.1 


6. 


1 


5,4 


5, 


5 


5.4 


5,5 


5,51 


1.17 


Persuasiveness 


4 


.1 


4. 


9 


4.0 


4. 


4 


4.1 


4.3 


4.49 


2.24 


Physical Stamina 


n 
J 


.5 


5. 


3 


4.0 


2. 


1 


4.6 


3.2 


3.14 


3.29 


Self Control 


5 


.4 


6. 


0 


5.6 


5. 


3 


5.7 


5.0 


5.25 


1.55 


Tact 


6, 




5. 


7 


6.3 


5. 


7 


6.0 


5.4 


5.59 


1.38 
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